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Abstract. This is the third in a series of papers in which we prove a 
conjecture of Boston and Shalev that the proportion of derangements 
(fixed point free elements) is bounded away from zero for transitive 
actions of finite simple groups on a set of size greater than one. This 
paper treats the case of primitive subspace actions. It is also shown that 
if the dimension and codimension of the subspace go to infinity, then 
the proportion of derangements goes to one. Similar results are proved 
for elements in finite classical groups in cosets of the simple group. The 
results in this paper have applications to probabilistic generation of finite 
simple groups and maps between varieties over finite fields. 



1. Introduction 

Let G be a finite group and X a transitive G-set. An element g ^ G is 
called a derangement on X \i g has no fixed points on X. We are interested 
in showing that under certain hypotheses the set of derangements of G on X 
is large. A conjecture due independently to Shalev and Boston et. al |BDF] 
states that if l-'^l > 1 and G is simple, then there is a universal constant 
5 > such that the proportion of elements of G which are derangements on 
X is at least 5. 

We note that the study of derangements has applications to maps between 
varieties over finite fields and to random generation of groups. For details see 
the partially expository papers |DFG] and [FGl] , as well as |GW] and |FG4| . 
Serre's survey [Sij describes applications in number theory and topology. 
Finally, we remark that results in this paper are applied in the derangement 
problem for almost simple groups (where the analog of the Boston-Shalev 
conjecture fails); see for example [ FG3j . See also the recent paper |KLSj for 
another application to probabilistic generation of finite groups. 

In |FG1] we announced a proof of this conjecture and treated the case 
of finite Chevalley groups of bounded rank. The paper |FG5| gives another 
proof in the bounded rank case and solves the Boston-Shalev conjecture for 
most other cases (all except subspace, extension field, and imprimitive group 
actions). The current paper treats the case of subspace actions, and the 
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sequel [FG2] treats extension field and imprimitive group actions, completing 
the proof of the Boston-Shalev conjecture. Prior to our work Shalev |Shj 
had analyzed many families of actions for the special case of PGL(n,q). 
However the case of subspace actions was not considered, and we resolve it 
here. We also treat a generalization (useful for the applications to curves) 
in which we study the proportion of derangements in a coset gH of a simple 
group H in a larger group G with G/H cyclic. 
Our main result is as follows: 

Theorem 1.1. Let G be a simple classical group defined overFq with natural 
module V . Let denote a G-orbit of nondegenerate or totally singular k- 
spaces with k < (1/2) dim 

(1) There exists an absolute constant 6 > such that the proportion of 
elements of G not fixing an element ofT^ is greater than 6. 

(2) The limit of the proportion of derangements acting onT^ as k ^ oo 
is 1. 

Note that if k is fixed, then in fact the proportion of derangements does 
not approach 1. 

Next we describe the contents of this paper. Section [2] discusses pre- 
liminaries which will be used freely throughout the paper. These include 
cycle indices for the finite classical groups, enumerative formulae for various 
types of irreducible polynomials, related generating function identities, and 
generalities about asymptotics of generating functions. 

Section [3] studies random permutations. First it examines the probability 
that a random permutation fixes (i.e. leaves invariant) a k-set, extending a 
result of Dixon to cosets of the alternating group. It also proves results 
about random permutations which will be needed in showing asymptotic 
equidistribution of regular semisimple elements of finite classical groups over 
cosets. Section [3] gives analogs of results of Section [3] for other Weyl groups. 

Section [5] describes relationships between maximal tori and conjugacy 
classes in the Weyl group. A typical consequence is that the proportion 
of elements of GL{n, q) which are regular semisimple and fix (i.e. leave 
invariant) a k-space is at most the proportion of permutations in Sn which 
fix a k-set. 

Section [6] handles the case that the field size goes to infinity (either with 
fixed rank or increasing rank). Here we can use some algebraic geometry 
and algebraic group theory (although for the case of increasing rank, one 
needs to get precise bounds). 

Section [7] focuses on the proportions of regular semisimple elements in 
finite classical groups. It reviews and extends results of [GuLub] and [FNP] . 
It derives a cycle index for Q^{2n,q) in even characteristic. Section [7] also 
uses combinatorics of maximal tori and the method of Section [5] to prove 
equidistribution of regular semisimple elements over cosets. 

Section [8] proves that with high probability, an element of a finite classi- 
cal group is nearly regular semisimple, that is regular semisimple on some 
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subspace of bounded codimension. Whereas Section [5] enables one to study 
proportions of elements of G which are regular semisimple and derange- 
ments on k-spaces, the results of Section [8] allow one to move beyond reg- 
ular semisimple elements (for fixed q the proportion of regular semisim- 
ple elements doesn't tend to 1). For example it will be shown that when 
1 < k < n/2 — )• oo, the proportion of elements in SL(n,q) which are de- 
rangements on k-spaces tends to 1. (Prior to this paper it was not even 
known that this proportion was bounded away from zero). We expect our 
results on nearly regular semisimple elements to have many other applica- 
tions. 

Section [9] applies the tools of earlier sections to prove the Boston-Shalev 
conjecture (and a generalization for cosets) for primitive subspace actions. 
It moreover shows that for such actions with |G| sufficiently large, the pro- 
portion of derangements in subspace actions is at least d = .016 (and often 
much better); the paper [BDF] speculates that one may be able to take 
6 = 2/7. Most of our bounds are actually for the proportion of elements 
of G which are regular semisimple and derangements. Section [9] also shows 
that as the dimension and codimension of the subspace grow, the proportion 
of derangements tends to 1. 

2. Preliminaries 

2.1. Cycle indices. To begin we review a tool which will be used through- 
out this paper: cycle index generating functions of the finite classical groups. 
Modeled on the cycle index of the symmetric groups (to be discussed in 
Section [3]), these generating functions were introduced for GL in [Kj, fur- 
ther exploited for GL in [St], generalized to U,Sp,0 in [F], and applied in 
[F] . [FNP] ■ |Wa| . Section [7| will use a cycle index for Q^{2n,q) in even char- 
acteristic. Work of Britnell ( [B1] . [B2] ) gives cycle indices for SL and SU, 
and for some variants of orthogonal and conformal groups ( |B3] , [B4j ) . 

The purpose of a cycle index is to study properties of a random group ele- 
ment depending only on it conjugacy class; we illustrate the case of GL{n, q) 
and refer the reader to the references in the previous paragraph for other 
groups. As is explained in Chapter 6 of the textbook [H], an element 
a G GL{n,q) has its conjugacy class determined by its rational canoni- 
cal form. This form corresponds to the following combinatorial data. To 
each monic, non-constant, irreducible polynomial (p over the finite field F^, 
associate a partition (perhaps the trivial partition) A,^ of some non-negative 
integer |A<^|. Let deg((/>) denote the degree of (p. The only restrictions nec- 
essary for this data to represent a conjugacy class are that IA2I = and 
^0 I A^l deg((/)) = n. Note that given a matrix a, the vector space V on 
which it acts uniquely decomposes as a direct sum of spaces where the 
characteristic polynomial of a on is a power of (p and the characteristic 
polynomials on different summands are coprime. Each decomposes as a 
direct sum of cyclic subspaces, and the parts of A^ are the dimensions of the 
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subspaces in this decomposition divided by the degree of (f). For example, 
the identity matrix has Xz-i equal to (1") and all other equal to the 
empty set. An elementary transvection with a 7^ in the (1,2) position, 
ones on the diagonal, and zeros elsewhere has Xz-i equal to (2, and 
all other A<^ equal to the empty set. For a given matrix only finitely many 
X(f, are non-empty. 

Many algebraic properties of a matrix can be stated in terms of the data 
parameterizing its conjugacy class. For instance the characteristic polyno- 
mial of a G GL{n, q) is equal to (j)\^<t'i'^)\ and the minimal polynomial of 

a is equal to where A^^i is the largest part of the partition A,^. 

Furthermore a £ GL{n, q) is semisimple if and only if all X(f,{a) have largest 
part at most 1, regular if and only if all A<^(a) have at most 1 part, and 
regular semisimple if and only if all A0(a) have size at most 1. To define 
the cycle index for ^GL(n,g)! l^t x^^a be variables corresponding to pairs of 
polynomials and partitions. Define 

Note that the coefficient of a monomial is the probability of belonging to the 
corresponding conjugacy class, and is therefore equal to one over the order 
of the centralizer of a representative. Let mj(A) be the number of parts of 
size i of A, and let A- denote the number of parts of A of size at least i. It is 
well known (e.g. easily deduced from page 181 of [M]) that the size of the 
conjugacy class of GL{n, q) corresponding to the data {A,^} is 

\GLin,q)\ 



where 

It follows that 



n deg{0).E,(A;,,)^ rr / 1 N ' 
LLcp'i iii>l\qdce(4,) JniiiX^) 

{l/q),={l-l/q){l-l/q')---il-l/q^). 



oo 



n=l (f)j^z 



gdegW.E.(AO^ n.>l 

This is called the cycle index generating function. 



X 



^|A|-dcg{0) 



„dcg(0) ) , 



2.2. Polynomial enumeration and related identities. Next we recall 
some results about enumeration of various types of irreducible polynomials 
and related identities. (The enumerative results are only really required 
in Section [8] and only upper bounds are used. However as exact formulas 
are available, we state them). Let N(q;d) denote the number of monic 
irreducible degree d polynomials over ¥q with non-zero constant term. Let 
fj, denote the Moebius function of elementary number theory. The following 
result is well known and appears for example in |LiN] . 
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Lemma 2.1. N{q;l) =q-l and for d > 1, N{q;d) = 3 Er|d /"(^)/^''- 

Next we consider analogous results useful for treating the unitary groups. 
Let cr : X I— )• x"^ be the involutory automorphism of ¥^2. This induces 
an automorphism of the polynomial ring Fg2[z] by sending X^o<i<n^«-^* *o 
Y2o<i<n •2*- Then given a polynomial (j){z) with coefficients in the field ¥^2 
and non-zero constant term, define an involutory map (/) 1— t- by 



Z 



0(0)- 



The polynomial (j) is called the conjugate of (p. 

Let N(q; d) denote the number of monic irreducible self-conjugate degree 
d polynomials over F^2. Let M{q;d) denote the number of (unordered) 
conjugate pairs {(p, 0} of monic irreducible polynomials of degree d over ¥^2 
that are not self-conjugate. 

Lemma 2.2. Theorem 9) 
(1) 

if d is even 

+ is odd 



N{q;d) 

(2) 

f l{q^-q-2) ifd=l 



M{q-d) 



hT.r\df^ir){q'^'^/'- -q'^/') if d is odd and d>l 



Finally we consider analogous results useful for treating the symplectic 
and orthogonal groups. Given a degree n monic polynomial (p{z) with (j){0) 7^ 
0, define its conjug ate (p*{z) := Let N*{q;d) denote the number 

of monic irreducible self-conjugate polynomials of degree d over ¥q, and let 
M*{q; d) denote the number of (unordered) conjugate pairs {(p, (j)*} of monic, 
irreducible, non-self-conjugate polynomials of degree d over ¥q. 

Lemma 2.3. /" [FNPj ) Let f = 2 if the characteristic is odd and f = 1 if the 
characteristic is even. 

(I) 



N*{q-d) 



f ifd = l 

if d is odd and d > 1 

lE r\d ^(r)(g'^/(2'-) + 1 _ /) ifd is even 

r odd 



Uq-f-l) zfd=l 
M*{q]d) = { |A^(g;(i) ifd is odd and d>l 

^{N{q;d) - N*{q;d)) ifd is even 
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The following generating function identities will be useful. Lemma 12.41 is 
well known; see for instance [F] . 

Lemma 2.4. Suppose that \u\ < q^^ . Then 

1-u 



Lemma 12.51 will be useful. 



11(1 

i>i i-^« 



Lemma 2.5. Suppose that \u\ < q ^. 

(1) nd>in.>i(i-#^) =(i-")-' 

(2) n.,, n.,, (i + ^)-^"^* (i - fi)-""'' = (I - 

(3) Let f = 1 if the characteristic is even and f = 2 if the characteristic 
is odd. Then 

n(i-^ nn 1+^^ (i-^ 

j>l ^ ^ ^ d>li>l \ / \ 

Proof. For the first assertion, note by Lemma 12.41 that 

^d^-Niq;d) ^ ^^^^-N{g;d) 



nn = nn 

For the second assertion, the left hand side is equal to 

^^-N{g;d) ^ ^,2d\-M{q;d) 



nn(i-^ 



i odd d> 1 



U \ I ^ u 

lid 



By parts a and c of Lemma 1.3.14 of |FNPj . this is equal to 



yr (I+VqO yr (1 - u/q') ^ , 
J-J- (1-qu/q^) J-J- (1 + qu/q^) ^ ' 

i odd^ ^ ' ^ ' i even ^ ' ^ I ^ / 

For the third assertion, 

nn 1+^^ i^-^d 

d>li>l \ y \ H 
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is equal to 

nn 

i oddd>l V "I / V 
i evend>l ^ ^ / \ ^ y 

By parts a and d of Lemma 1.3.17 of |FNP| . this is equal to 

i odd i even 



□ 



The statement of Lemma 12.61 uses the partition notation of Subsection 
Lemma 2.6. (^) 

We also record the following identity as it will be needed. 
Lemma 2.7. (Euler) 
(1) 



rr(i--) = y ^ 



. (9" - 1) •••(?- 1) 



n(i--)-^=y ^ 

The following lemma is Euler's pentagonal number theorem (see for in- 
stance page 11 of [AlJ). 

Lemma 2.8. For q> \, 

1 °° 

n,, i , , V^/ -Ml/ riCin-l) n(3n + l) 

(1--) = l + ^(-ir((7 -^+q —) 



{I) 



i>X ^ n=l 



= 1 - - + + g"'^ - g"^^ - g"^^ H 

Throughout this paper quantities which can be easily re-expressed in 
terms of the infinite product n£i(-'- ~ ^) sometimes arise, and Lemma 



gives arbitrarily accurate upper and lower bounds on these products. 
Hence we will state bounds like niS:i(l + ^) = Tli^i !-|_x! — ^-^ without 
explicitly mentioning Euler's pentagonal number theorem on each occasion. 
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2.3. Generating function asymptotics. Given two generating functions 
— Yln>o — X^n>o dnu"", the notation / << g means that 

\fn\ < \gn\ for all n. This will be used throughout this paper. 

In determining the limiting probabilities of the generating functions con- 
sidered in this paper, we shall sometimes use the following standard result 
about analytic functions. 

Lemma 2.9. Suppose that g{u) = Y^^=o ^n^" OL''^d g{u) = /(n)/(l — u) for 
|n| < 1. Let D{R) denote the open disc consisting of complex numbers u with 
\u\ < R. If f{u) is analytic in D{R), where R> 1, then lim„_>.oo On = /(I) 
and |o„ — /(1)| = o(r~") for any r such that 1 < r < R. 

Proof Define F(l) = /'(I) and F{u) = (/(I) - /(n))/(l - u) elsewhere in 
D(R). Then F is analytic in that disc and must be represented by a Taylor 
series Y2n ^n^" converging there. If 1 < r < i? then ^ 6„r" converges and so 
bn.r"' — ^ as n — ^ oo, that is = o(r~"). Now g{u) = /(1)/(1 — n) — F{u) 
and therefore a„ = /(I) — 6„. Thus a„ — )■ /(I) and |a„ — /(1)| = o(r~") as 
n — )■ oo. □ 



3. Alternating and symmetric groups 

This section studies conjugacy class properties of random permutations. 
It begins by reviewing the cycle index of the symmetric groups. Then it 
discusses the probability that a random permutation fixes a k-set, extending 
an upper bound of Dixon to cosets of the alternating group. It also discusses 
an upper bound of Luczak and Pyber. Finally, this section proves results 
about random permutations which will be needed in showing asymptotic 
equidistribution of regular semisimple elements of finite classical groups over 
cosets. 



3.1. Cycle index of the symmetric groups. For a permutation tt let 
nj(7r) be the number of length i cycles of vr. Polya proved that 

CO ^ 

n=l n£S„ i>l m>l 

This follows from the fact that the number of permutations in Sn with nj 
cycles of size i is equal to n — i- This generating function is called the 
cycle index of the symmetric groups, because it stores complete information 
about the cycle structure of permutations. This cycle index will be used 
several times in this paper. 

An integer valued random variable Z is said to be Poisson of mean A if 
the chance that Z = k is pr^- The following result of Shepp and Lloyd 
will be important. For in-depth discussions of Theorem 13. H see [DPi] or 
[AT] . Theorem 13.11 follows from the cycle index of the symmetric groups 
and Lemma 12.91 
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Theorem 3.1. (^ShLl]j Given a permutation, let ni^n) denote the num- 
ber of i- cycles of vr. Then for fixed k and vr random in Sn, the vector 
(ni(7r), • • • , nfc(7r)) converges as n oo to {Zi, ■ ■ ■ ,Zk), where the Z 's are 
independent and Zi is Poisson with mean 

3.2. Chance of fixing a k-set. Motivated by questions about random gen- 
eration and computation of Galois groups, Dixon [D] examined the proba- 
bihty that a random permutation fixes (i.e. leaves invariant) a k-set. Note 
that we can suppose that 1 < A; < n/2, since a permutation fixes a k-set if 
and only if it fixes an n-k set. 

Theorem 3.2. For \ < k < n/2, the proportion of elements in Sn 

which fix a k-set is at most 2/3. 

Our next goal is to prove that for n > 5 (so that is simple), the 
proportion of derangements of a coset of gAn on fc-sets is at least 1/3. 

Lemma 3.3. Let gAn he a coset of An in Sn- Then for 1 < j < n — 2, the 
proportion of elements in gA^ with the property that the cycle containing 1 
has length j is ^. 

Proof. There are ( "Zi) ways of choosing the elements to be in the cycle with 
1 and {j — iy. ways of ordering them. Since n—j > 2, the number of elements 
in either coset of An-j in Sn-j is (n — j)!/2. The result now follows since 

C;z})(j-l)!(n-j)!/2 



Theorem 3.4. Let gAn be a coset of An in Sn- 

(1) For 2 < k < n/2, the proportion of elements in gAn which are 
derangements on k-sets is at least 1/3. 

(2) For n > 5, k = 1, the proportion of elements in gAn without fixed 
points is at least 1/3. 

In particular, when An is simple, the proportion of derangements in a coset 
gAn on k-sets (1 < k < ^) is at least 1/3. 

Proof. For the proof of part 1 we use a method similar to that of Dixon [D] . 
Let /(n, k) be the set of elements in gAn which leave invariant a k-set and let 
i{n,k) = ^1^^'^^^ be the proportion of such elements. Let C{n,j) be the set 
of permutations in gAn such that the cycle containing 1 has size j. Consider 
the set I{n, k) n C{n,j). For n — k < j this set is empty. For 1 < j < A; or 

j = n — k — l,n — k note that |/(n, k)riC{n, j)\ < \C{n,j)\ = by Lemma 
13.31 since j < n — 2. For each j satisfying k -\- 1 < j < n — k — 2, observe 
that a fixed k-set must use only symbols outside of the cycle containing 
1. Thus the proportion of such elements is at most ^i{n — j,k). Now use 
induction on n. The base case n = 4 is easily checked, and i{n — j,k) < 2/3 
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if A; < (n — j)/2 and otherwise i{n — j, k) = i{n — j,n — j — k) < 2/3 since 
n — j — k > 2. Thus 

t + 2+(n-2t-2)2/3^ 
n 

since k > 2. 

For the proof of part 2 we use the cycle index of the alternating groups. 
This is the average of the cycle index of the symmetric groups and the cycle 
index of the symmetric groups with Xi replaced by — Xj for i even. Setting 
xi = and Xi = 1 for i > 2 gives that the proportion of derangements (on 
1-sets) in An is the coefficient of in 



i>2 i>2 ^ ' 



Using the power series expansion for e~", it is straightforward to see that 
for n > 5, this coefficient is at least 1/3. Similarly, for the other coset of 
in S'n, the proportion of derangements is the coefficient of in 

1 _ l + u 
e"(l - u) e" ' 

which is at least 1/3 for n > 5. □ 

Concerning large k, we will need the following result of Luczak and Pyber 
[LucPyl , which shows that as A; — )• oo, the proportion of elements in S„ which 
are derangements on fe-sets approaches 1. 

Theorem 3.5. (' [LucPyl J There is a universal constant A such that the 
probability that a random element of Sn fixes a k-set is at most Ak~'^^ for 
l<k< n/2. 

To close this subsection, we establish results which will be useful in ana- 
lyzing subspace actions of SL{n, 3). 

Lemma 3.6. For n>2, the chance that an element of Sn has 1 or 2 fixed 
points is at most 3/5. 

Proof. For n = 2,3,4 one checks this directly. For n > 5, it follows from 
the cycle index (or from inclusion-exclusion) that the proportion of elements 
with 1 fixed point is Er=o^(-l)7«' < 1/2 - 1/6-M/24 and the that propor- 
tion of elements with 2 fixed points is \ Er=o^(-l)'A! < .5(1/2-1/6+1/24). 
Adding these bounds together gives .5625 < 3/5. □ 

Lemma 3.7. For 2 < k < n/2, the chance that an element in Sn fixes a 
k-set and has at most 2 fixed points is at most 3/5. 

Proof. The method of proof is an induction along the lines of Lemma 2 of 
Dixon m. Let I{n,k) be the set of elements in S„ which fix a k-set and 
have at most 2 fixed points, and i{n,k) = ■'^^^r^- Let C{n,j) be the set of 
permutations such that the cycle containing the element 1 has size j. Now 
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consider the set I{n,k) n C{n,j). This set is empty for n — k < j. For 
k + 1 < j < n — k — 2, any element of this set fixes a k-set which is disjoint 
from the cycle containing 1. Thus \I{n,k) PI C{n,j)\ = (n — l)\i{n — j,k), 
and using the fact that z(n — j, k) = i{n — j,n — j — k) it follows by induction 
that in this case \I{n,k) H C{n,j)\ < |(n — 1)!. If j = n — k — 1 then 
\I{n,k) n C{n,j)\ < |(n — 1)!, since by Lemma 13.61 the proportion of vr G 
Sn-j with one or two fixed points is < 3/5. Finally, \i j < k oi j = n — k, 
then |/(n, /c) n C(n, j)| < |C(n,j)| = (n - 1)!. Hence 

i{n, k) <{k + l + 2,{n-2k- l)/5)/n < 3/5 

where the second inequality follows because k>2. □ 

3.3. Other results on random permutations. This subsection derives 
a result on random permutations which will be useful in analyzing how the 
proportion of regular semisimple elements varies over cosets of SL(n,q) in 
GLin,q). 

We begin with two lemmas bounding coefficients of certain generating 
functions. 

Lemma 3.8. For < t < l,r > 1, the coefficient of in (1 — is at 

most ^e^{rY . 

Proof. This coefficient is equal to ^ 111=1(1 ^\)- Taking logarithms (base 
e), one sees that 

< VT<t(l + log(r-l)). 
^-^ I 

i=l 

Take exponentials one sees that the sought proportion is at most -e*(r)*. □ 



log 



Recall the notation << defined in Subsection 
Lemma 3.9. For p > 2 fixed, the coefficient of in ^^-V {Yli>i^) 

Q ( log(") 
V pn 

Proof. Let f{u) = exp ^X]i>i fn denote the coefficient of 

in f{u). Considering the coefficient of in the derivative of f{u), one 
obtains the recursion 

71—1 ^ 



pnfn = ^ fj 



Since 



n 



f{u) « exp I /i 

i>l 
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log(n)\ 
pn J ' 

as claimed. □ 



it follows that fn ^ ^- This with the recursion gives that fn = 



Theorem 3.10. Let ai, • • • ,ar he the distinct cycle lengths of a permutation 
and let mi,-- - ,mr be the multiplicities with which they occur. Then the 
proportion o/ vr G Sn satisfying gcd(aimi, - - - ,armr,q — 1) ^ 1 is at most 

^°f/ for a universal constant ci (independent ofn,q). 

Proof. Letting p be a prime, we show that the proportion of vr G with 
gcd{aimi, - - - , arm^) divisible by p is at most l^f/^'' foi" ^ universal con- 
stant ci. This is enough since n has at most log2(n) distinct prime factors. 

The proportion of permutations satisfying gcd{aimi, - - - ,armr) divisible 
by p is at most the proportion of permutations where all cycles of length not 
divisible by p occur with multiplicity a multiple of p. From the cycle index 
of the symmetric groups, the latter proportion is the coefficient of in 



n^- n [^+^.+w(2py.+ 

~ 9cd{i,p) = l 

(„ ip „ 2ip \ 

iPp i2pp22! 



i>l 

gcd{i,p) — l 



i>l 




= (l-nP)-i/Pexp 

« (l-nP)"^/^exp 

This is simply the coefficient of u'^^p in 

(l-u)-i/fexp 

It follows from Lemmas 13.81 and 13.91 that the sought coefficient is at most 




C 



logW , ^-1/2 , „-l/2 . log(") 



n ^ — ' n — pr 

r=l 



for a universal constant C. Note that the first term came from upper bound- 
ing the coefficient of -u"/^ in exp ^X]i>i ^) ' that the second term came 
from upper bounding the coefficient of u"^p in (1 — u)~^^p. Splitting the sum 
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into two sums (one with r ranging from 1 to ^ and the other with r rang- 
ing from ^ + 1 to ^ — 1) proves that the proportion of permutations with 

gcd{aimi, ■ ■ ■ , arUir) divisible by p is at most O ( ^"^[^2 ) > claimed. □ 



4. Results for other Weyl groups 

This section extends results of Section [3] to other Weyl groups, and con- 
siders various analogs of the property that a random permutation fixes a 
k-set. 

To begin we review the cycle index of the hyperoctahedral group 
Given an element vr G let nj(7r) be the number of positive i-cycles of 
TT and let mi(7r) be the number of negative i-cycles of vr. From [JKj, the 
conjugacy classes of Bn are indexed by pairs of n-tuples (ni, • • • ,n„) and 
(mi, • • • , m„) satisfying Y^ - i{ni + mi) = n, and a conjugacy class with this 
data has size j-j n \m \{2i)"i+"^i ' noted in [DPi] , this can be conveniently 
encoded by the equation 

n>l irGBn i>l i>l 

This equation is referred to as the cycle index of the hyperoctahedral groups. 

In analogy with Theorem 13. 11 Diaconis and Pitman obtained the following 
result. 

Theorem 4.1. Given vr € Bn, let nj(7r), mj(7r) denote the number of positive 
and negative i-cycles of n respectively. Then for fixed k and vr random in 
Bn, the vector (ni(7r),mi(7r), • • • , nfc(7r), mfc(7r)) converges as n ^ oo to 
{Yi, Zi, ■ ■ ■ ,Yk,Zk) where all the Y's,Z's are independent and Yi,Zi are 
both Poisson random variables with mean l/{2i). 

Lemma 14.21 and Theorem 14.31 will be useful in analyzing the action of the 
unitary groups on totally singular k-spaces. 

Lemma 4.2. (1) The proportion of elements in S2k with all cycles even 

IS 

(2) This proportion of part 1 is decreasing in k so is maximized for k = 1 
when it is equal to 1/2. 

-. ^1 2 -, 

(3) The proportion of part 1 is at most ^^^^^^^ e^^fc lat+i < ^^^^^^^ and 
is asymptotic to ^^^^1/2 • 
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Proof. From the cycle index of the symmetric groups (reviewed in Section 
El, it fohows that the sought proportion is 

Coef. of u^^ inYle"^ = Coef. of u^^ in (1 - u^)-^/"^ 

i>l 

= Coef. of in (1 - u)-^''^ 

^ SI 

4k ■ 

For the second assertion, observe that 

O _13 2k-l 



4*^ 2 4 2k ' 
The third assertion follows from Stirling's bounds 

(2^)5n"+5e-'^+i/(i2n+i) ^ ^, ^ ^2vr)5n"+^e-"+i/(i2n) 

proved for instance on page 52 of [Fe|. □ 
Theorem 4.3. For 2 < 2k < n, the probability that an element of Sn fixes 

/2fe^ 

a 2k-set using only even cycles is at most < ^^^^^1/2 • 

Proof. Some subset of the cycle lengths of vr are even and add to 2k. (For 
instance if 2k = 6, then at least one of (6), (4, 2), (2, 2, 2) must appear as 
cycle lengths). Using the fact that the number of permutations with i- 
cycles is j-^^";.^ , , it follows that the proportion of elements in Sn fixing a 
2/c-set using only even cycles is at most 

^ X] n ia,Q.] n ia^+h^^a^ + bi)\' 

tb2,b^,'-') (til,'-' ,an) i odd 1 even 

Note that here + bi is the number of i-cycles of vr, and that equality holds 
if 2k = n. Since , \ n, < —jj-,, the sought proportion is at most 

(b2,b^,--) i even (ai,-'-,a„) i>l 

262+464 + -'-=2fe lai+2a2 + - ■ ■=n—2k 

Observe that ^ 

{ai,--- ,an) i>l 
la-\^-\-2a2-\ — n — 2fc 

being the sum of reciprocals of centralizer sizes over all conjugacy classes of 
the group Sn-2k- Hence the sought proportion is at most 

(b2,b^,---) i even 
262+4i)4 + ---=2*: 

which is the probability that an element of S2k has all cycles even; the result 
thus follows from Lemma l4.2[ □ 
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Next we study the probabiHty that an element tt G Bn fixes a k-sei using 
only positive cycles. 

Theorem 4.4. (1) The proportion of elements in Bn which fix a k-set 
using only positive cycles is at most the proportion of elements in 
Bk with all cycles positive. 
(2) The proportion of elements in B^ with all cycles positive is equal to 
the proportion of elements in S2k with all cycles even (which was 
bounded in Lemma\4.2^. 



Proof. Recall the description of conjugacy classes and centralizer sizes of 
Bn given at the beginning of this subsection. If an element of Bn fixes a 
k-sei using only positive cycles, then its cycle structure vector must contain 
positive cycles of lengths adding to k. Thus the chance that an element vr 
of Bn fixes a k-set using only positive cycles is at most 

J2 Il^ai + b^y.Ci\i2ir^+^^+'^^' 

(t>l,i>2.--- .fcfc) (a^,.-- ,ti„),(ci,--- ,c„) I ^ 

61+262 +•■■ = *! (ai+ci)+2(a2+C2) + -- ■=»-*! 

with equality if n = k. Here Oj + hi is the number of positive z-cycles of vr 
and Ci is the number of negative z-cycles of vr. Since x, < --17-7, the 
sought proportion is at most 

bi\{2ifr W ai\ci\{2iY^ 

(bl,b2,--- ,bf.) (ai,--- ,a„),(ci,--- ,c„) i 

6i+262 + ---=fe (ai+ci)+2(a2+C2) + -- 

Observe that 



^ n ai\ci\{2iY^+''^ 

(aj,--- ,an),(ci,--- ,c„) i 
(ai+ci)+2(a2+C2)H — n — fc 

being the sum of reciprocals of centralizer sizes over all conjugacy classes of 
the group Bn~k- Thus the sought proportion is at most 

n b U2iYi 

(6i,62,--,6fe) i ^ 
6i+262 + -'- = fc 

which is the probability that an element of B^ has all cycles positive. Rewrit- 
ing this sum as 

{62,b4,--- ii'2fc) i even 
262+464 + -'-=2fe 

shows that it is also the probability that an element of 5*2^ has all even 
cycles. □ 

We let Dn denote the group of signed permutations with the product of 
signs equal to 1; thus |-D„| = 2"'~^n!. We let -D~ denote the nontrivial coset 
of Dn in Bn, i.e. the group of signed permutations with the product of signs 
equal to —1. 
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Theorem 4.5. (1) For n > k, the proportion of elements of Dn which 
fix a k-set using only positive cycles is equal to the proportion of 
elements of D~ which fix a k-set using only positive cycles. Both 
proportions are at most the proportion of elements of S2k with all 
cycles even (which was bounded in Lemma \4-^ - 
(2) The proportion of elements of Dk with all cycles positive is twice 
the proportion of elements of S2k with all cycles even (which was 
bounded in Lemma\4.2\). 



Proof. For part 1, note that since n > k, there is a bijection between the 
elements of Dn which fix a k-set using positive cycles and the elements of 
D~ which fix a k-set using positive cycles (just change the sign of a cycle 
not involved in the k-set). Hence the number of elements of which fix a 
k-set using positive cycles is twice the number for D^, so part 1 follows from 
Theorem 14.41 Part 2 follows from part 2 of Theorem 14.41 since elements of 
Bn with all cycles positive lie in Dn- □ 

Theorem 4.6. (1) For n > k, the proportion of elements in which 
fix a k-set using an even (resp. odd) number of negative cycles is at 
most 1/2. 

(2) For n > k, the proportion of elements in which fix a k-set using 
an even (resp. odd) number of negative cycles is at most 1/2. 

(3) For n > k, the proportion of elements in Bn which fix a k-set using 
an even (resp. odd) number of negative cycles is at most 1/2. 



Proof. From the cycle index of the proportion of elements in 
fix a k-set using an even number of negative cycles is at most 



which 



Y^i{o.^ + b^) — k,J2bj^ even Y^i(c^-\-dj^) — n—k,J2dj^ even 



ll^{ai + C^y.{b^ + d^y.{2i)''^+b^+^^+d^ 



< 2 



, X] i(cj+d^ ) — n — fc,^ even 



U^cM\{2i:, 



Ci+a 



Here aj , bi denote the number of positive and negative z-cycles involved in 
fixing the fc-set, and Cj, di are the number of remaining positive and negative 
z-cycles. The first term in square brackets is the proportion of elements of 
Bk which lie in Dk, which is 1/2. The second term in square brackets is the 
proportion of elements of Bn-k which lie in Dn-k, which is also 1/2. This 
proves the first part of the theorem. The second part is proved similarly. 
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For n > k, part 3 is immediate from parts 1 and 2, and for n = k part 3 
follows since D„ is an index two subgroup of 5„. □ 

The following results about Bn and Dn will be useful for treating the 
cases q = 2,3. 

Proposition 4.7. (1) The proportion of elements of Bn with no positive 

fixed points and at most one negative fixed point is at most 7/12. 
(2) The proportion of elements of Bn (n>2) with at most one positive 
fixed point and at most one negative fixed point is at most 5/6. 

Proof. Prom the cycle index of the groups Bn, the proportion of elements 
with no positive fixed point and at most one negative fixed point is the 
coefficient of in p^^y^. This is easily seen to be at most 7/12, this value 

being attained at n = 3. For the second assertion, one uses the generating 
function 



{i+u/2y 

(l-M)e" 

attained at n = 



, and the coefficient of is at most 5/6, this value being 
3. □ 



Theorem 4.8. (1) The proportion of elements of Bn with an even num- 
ber of negative cycles, at most one negative fixed point, no positive 
fixed points, and no positive two cycles is the coefficient of vP' in 



2e«V4 



^(1 - u) 



(2) 



j4s n — >■ GO this coefficient approaches j^jz < .215. 
The proportion of elements of Bn with an odd number of negative 
cycles, at most one negative fixed point, no positive fixed points, and 
no positive two cycles is the coefficient of u"- in 



(1 + f) 
;"(1 



As n ^ oo this coefficient approaches -^jz < .215. 

Proof. For part 1, observe from the cycle index of S„ that the bivariate 
generating function (in n and the number of negative cycles) for elements 
with at most one negative fixed point and no positive fixed points or two- 
cycles is 



(i+f)e* n 



1+y 



,i>3 



( 



l + -je4 



1 



1 (l+J/)/2 



Here u indexes the number of symbols n and y indexes the number of nega- 
tive cycles. Averaging this over y = 1 and y = —\, one sees that the sought 
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proportion is the coefficient of it" in 



2g«2/4 



e«(l-n)^ 2' 



Disregarding the pole aX u = 1 this is analytic in a circle of radius greater 
than 1 which together with Lemma 12.91 completes the proof of part 1 . Part 
2 is proved along the same lines as part 1 (instead of the sum of the values 
at ?/ = ±1, one looks at the difference of the values). □ 



The same technique as in Theorem 14.81 proves the following result. 

Theorem 4.9. (1) The n — )• 00 proportion of elements of i?„ with an 
even number of negative cycles, at most one positive fixed point, at 
most one positive two-cycle, and at most two negative fixed points is 

tBt^ ^ -437. 

(2) The n — )• 00 proportion of elements of Bn with an odd number of 
negative cycles, at most one positive fixed point, at most one positive 
two-cycle, and at most two negative fixed points is -^2ge5/4 — -437. 

The following theorem will be useful. 

Theorem 4.10. (1) The n — )• 00 proportion of elements in Bn which fix 
a k-set using an even number of negative cycles, and have at most 
one positive fixed point and at most one negative fixed point is at 
most 



9 

— < .414. 



(2) The n ^ 00 proportion of elements in Bn which fix a k-set using an 
odd number of negative cycles, and have at most one positive fixed 
point and at most one negative fixed point is at most 



9 

— < .414. 



Proof. From the cycle index of Bn, the proportion of elements in Bn which 
fix a k-set using an even number of negative cycles, and have at most one 
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positive fixed point and at most one negative fixed point is at most 

E E 



(ai<l,--- ,af.),{bi<l,--- (ci<l,--- .c^ ) , (d^ < 1, ■ ■ ■ ,dn) 

'i{ai+bj^) = k,J2 even Y 'i{c^-\-dj^) — n — k 



< 



E 

(ai<l,-.,a;^),(6i<l,-.,bfc) 
Y, ^jX) even 



E 



(ci<l,--- ,c„),(di<l,--- 



UiCi\dil{2i 



\Ci+di 



to 



(1+1/2) 
ei/2 



4e' 



Here ai,6j denote the number of positive and negative z-cycles involved in 
fixing the fc-set, and Cj, di are the number of remaining positive and negative 
i-cycles. 

The first sum in square brackets is (by the cycle index of Bk) equal to 
the proportion of elements in Bf^ with an even number of negative cycles, 
at most one positive fixed point, and at most one negative fixed point; such 
elements lie in D^. so the proportion is at most 1/2. Thus the proportion of 
elements in Bn which fix a k-set using an even number of negative cycles, 
and have at most one positive fixed point and at most one negative fixed 
point is at most 1/2 multiplied by the proportion of elements of -Bn-fe with 
at most one positive fixed point and at most one negative fixed point. By 
Theorem 14. 1^ the n — t- oo limiting proportion of elements of Bn with at 
most one positive fixed point and at most one negative fixed point is equal 

which proves part 1 of the theorem. Part 2 is proved by 
the same reasoning. □ 

Theorem 14.111 gives a type D analog of Theorem 14.101 

Theorem 4.11. (1) The n — )• oo proportion of elements of (or D~) 
with at most one positive fixed point, at most one negative fixed point, 
and which fix a k-set using an even number of negative cycles is at 
most ^ < .414. 

(2) The n — 7- oo proportion of elements of Dn (or D^) with at most one 
positive fixed point, at most one negative fixed point, and which fix 
a k-set using an odd number of negative cycles is at most ^ < .414. 

Proof. Since k is fixed, we can assume that n > A: + 3. Then there is a 
bijection between elements in Dn with at most one positive fixed point, at 
most one negative fixed point and which fix a k-sei using an even number of 
negative cycles, and elements in D~ with the same restrictions. Indeed, one 
can switch the sign of a cycle of length > 2 which is not involved in the fc-set. 
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Hence the proportions in part 1 are equal to the corresponding proportions 
for Bn, and part 1 is immediate from Theorem part 1 of Theorem 14.101 
Similarly part 2 follows from part 2 of Theorem 14.101 □ 

The next theorem will also be useful. 

Theorem 4.12. (1) The n — )• oo proportion of elements of with no 
positive fixed points, at most one negative fixed point, and which fix 
a k-set using an even number of negative cycles is at most .276. 

(2) The n — )• oo proportion of elements of Bn with no positive fixed 
points, at most one negative fixed point, and which fix a k-set using 
an odd number of negative cycles is at most .276. 

(3) The n — )■ cxD proportion of elements of ( or D~) with no positive 
fixed points, at most one negative fixed point, and which fix a k-set 
using an even number of negative cycles is at most .276. 

(4) The n — >• oo proportion of elements of Dn ( or D~) with no positive 
fixed points, at most one negative fixed point, and which fix a k-set 
using an odd number of negative cycles is at most .276. 



Proof. For parts 1 and 2, arguing as in Theorem 14. 101 shows that the sought 
proportion is at most 1/2 times the n — )• oo limiting proportion of elements 
of Bn with no positive fixed points and at most one negative fixed point. 
By Theorem 14. 1^ this is equal to 

1 
2 



11. 

(1 + 1/2) 



< .276. 



_gl/2 gl/2 

For parts 3 and 4, one argues as in Theorem 14.111 to reduce to the Bn 
case. □ 



5. Maximal tori and the Weyl group 

For G a finite classical group, this section gives upper bounds on the 
proportion of elements of G which are regular semisimple and fix a A;-space 
in terms of the proportion of elements of the Weyl group W which fix a k- 
set. Since finite classical groups contain many regular semisimple elements 
(this is made more precise in Section [7]) , this will enable us to bound away 
from the proportion of elements of G which are regular semisimple and 
derangements on /c-spaces. 

Let X be a simple algebraic group with a = CTq a. Frobenius endomor- 
phism. We only consider the case where cr is either a field automorphism 
or a field automorphism times a graph automorphism r of order 2 (since we 
are only dealing with classical groups and we may assume the rank is large, 
this is not a problem). Let G = X„, the set of fixed points of a. This is a 
Chevalley group defined over the field of q elements. 

Let W denote the Weyl group of X and Wq := {W, r) the extended Weyl 
group (i.e. the normalizer of a maximal torus T of X in {X, r) — we may 
choose r to normalize some u-invariant maximal torus r). In order to state 



DERANGEMENTS IN SUBSPACE ACTIONS OF FINITE CLASSICAL GROUPS 21 



the results uniformly, we view r = 1 if the graph automorphism is not 
present. 

There is a bijection between conjugacy classes of Wq in the coset tW 
and conjugacy classes of maximal tori - if w in W, let Ty^ denote the cor- 
responding maximal torus in G (up to conjugacy) — see |SSj for the basic 
background on this. 

We say that is nondegenerate if the centralizer of in the algebraic 
group is a (maximal) torus. Let Ny^ denote the normalizer of T^. If T^, is 
nondegenerate, then Nw/T^, = Cwiw). In any case, |A^u,/T^| > |CvK(it')|- 
If x G G is regular semisimple, then a; is in a unique maximal torus (its cen- 
tralizer). Also, if Tyj contains a regular semisimple element, then it certainly 
is nondegenerate. 

Choose a set of representatives R for the conjugacy classes in the coset 
tWq. If 5 is a subset of R, let Gs denote the set of semisimple elements of 
G conjugate to an element of for some w G S. So Gs is the union of all 
the conjugates of T^, for w £ X. Note that the union of conjugates of T^, 
has size at most [G : A^«,]|T^| = |G|/|Cvi/('w)|. 

Thus, 

\Gs\/\G\ < \G\-' Y.[G : iV^llT^I = J] \Gw{w)\-' = J] jl^rV^I 
wes wgs wes 

is equal to the proportion of elements of W conjugate to an element of S. 

If we want to estimate the proportion of regular semsimple elements con- 
jugate to an element of Tw,w £ S, it suffices to sum over those which 
contain a regular semisimple element and so improve the estimate (for q suf- 
ficiently large, all maximal tori will contain semisimple regular elements). 

Let G be a classical group over a finite field with natural module V. Let 
U be either a totally singular or nondegenerate subspace of V. Suppose that 
X G G is regular semisimple with T the maximal torus of G containing x. 

Note that if G = SL, Sp or SU, then x has distinct eigenvalues on V, 
whence x and T have precisely the same invariant subspaces. If the stabilizer 
of U is connected (in the algebraic group), then any semisimple element 
stabilizing is in a maximal torus of U. In particular, this holds if the 
characteristic is 2 or [/ is totally singular. So in those leaves U 

invariant if and only if T does. 

Finally, assume that the characteristic is not 2, {/ is nodegenerate of even 
dimension and G = SO'^(n,q). Let U' = [/"*". The connected part of the 
stabilizer of U is SO{U) x SO{U'). So if det{x\u) = 1, then T preserves U as 
well. The only other possibility is that det(a;|;7) = — 1. Indeed, in this case 
T need not leave W invariant. This forces x to have —1 as an eigenvalue on 
each of U and U'. 

We count these elements separately. If q is large, it is easy to show that 
the proportion of such elements goes to with g — )• oo (uniformly in n). 
We can also observe that such an x will fix a nondegenerate space U" with 
dim U = dim U" (by interchanging a — 1 eigenspace and a 1 eigenspace) with 
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detx|[/" = 1. Thus, x will be in a maximal torus fixing a nondegenerate 
space of the given dimension (of one type or the other). Moreover, any 
maximal torus containing such an clement x must have a fixed point and 
indeed if n is even, it must have two fixed points. 

Theorem 5.1. Suppose that \ < k < n/2. The proportion of elements of 
any subgroup between SL{n, q) and GL{n, q) which are regular semisimple 
and fix a k-space is at most the proportion of elements in Sn which fix a 
k-set. In fact, it is at most the proportion of elements in Sn which fix a 
k-set and have at most q — 1 fixed points. 

Proof. If w has cycles of length ai, . . . ,ar, then V = (BVi where dim 1^ = 
ttj and Tw acts irreducibly on each V^. As long as contains a regular 
semisimple element, then these are the only subspaces left invariant by 
(and so by any regular semisimple element in Tyj as well, because of the 
uniqueness oiTw). 

Thus, X regular semisimple in fixes a k-space if and only if w fixes a 
k-set (i.e % = A; for some subset of the aj). 

Note that for a fixed q, the number of 1-cycles in w is at most q-1 or 
will not contain any regular semisimple elements (and so not contribute). □ 

Theorem 5.2. (1) For 1 < k < n/2, the proportion of elements in any 
coset of SU (n, q) in U (n, q) which are regular semisimple and fix a 
nondegenerate k-space is at most the proportion of elements in Sn 
which fix a k-set. 

(2) For 1 < k < n/2, the proportion of elements in any coset of SU{n,q) 
in U (n, q) which are regular semisimple and fix a totally singular k- 
space is at most the proportion of elements in Sn which fix a 2k-set, 
using only even cycles. 

Proof. For SU (n, q), (r, W) = S'„ x Z/2 and so we are really again in Sn. 

Consider w having cycles oi , . . . , — then acts on Vi J- . . . J- Vr 
where diml/j = Oj. 

If CLi is odd, then Tyj is irreducible on Vi and if Oj is even, then Tyj leaves 
invariant precisely two proper subspaces each totally singular of dimension 
ai/2. 

Thus, the probability of being regular semisimple and fixing a nondegen- 
erate k-space is at most the probability of fixing a k-set. Fixing a totally 
singular k-space means we need a subset of the all even adding up to 
2k. □ 

We let Bn denote the hyperoctahedral group of signed permutations on 

n symbols. 

Theorem 5.3. (1) For 1 < k < n, the proportion of elements in the 
group Sp{2n, q) which are regular semisimple and fix a nondegenerate 
2k-space is at most the proportion of elements in Sn which fix a k-set. 
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(2) For 1 < k < n, the proportion of elements in Sp{2n, q) which are 
regular semisimple and fix a totally singular k-space is at most the 
proportion of elements in which fix a k-set using only positive 
cycles. 

(3) Consider the proportion of regular semisimple elements in Sp{2n, q). 
For q = 2 it is at most the proportion of elements in Bn with no 
positive fixed points and at most one negative fixed point. For q = 3 
it is at most the proportion of elements in Bn with at most one 
positive fixed point and at most one negative fixed point. 

Proof. View w in W as (ai, ei), . . . , (a^, e^) where (ai, . . . , a^) is a partition 
of n and = ±1. Let w denote the image of w in Sn (so it has cycles of size 

ai, a-r). 

Then V = Vi -L . . . .L Vr where dim Vi = 2aj and if ej = — , then acts 
irreducibly on Vi while if = +, then Vi = A(BB where A and B are totally 
singular subspaces of Vi with Ty^ acting irreducibly on A and B (with A and 
B nonisomorphic as T^-modules). Thus, the only nondegenerate subspaces 
left invariant by the are sums of Vj for some subset. So arguing as above, 
the proportion of elements which are both semisimple and leave invariant a 
nondegenerate subspace of dimension 2k is at most the probability that Hj 
fixes a k-set. 

For totally singular k-spaces (so k < n), we would need some subset of 
the Vi corresponding to = + with the Oj adding up to k. In particular, 
some subset of the must add up to k and so we get the same upper bound 
(or using positive cycles if we want a somewhat better bound) . 

Suppose that Tyj contains a regular semisimple element. If q = 2, there 
can be no positive 1-cycles (for then Ty^ is trivial on a 2-dimensional space) 
and can be at most 1 negative 1-cycle (otherwise either (T — 1)^ or (T^ + 
T + 1)^ divides the characteristic polynomial of any element of Tyj). 

If g = 3, similarly we see that there can be at most 1 positive 1-cycle 
(using the fact that any element has det = 1 - if we are in the conformal 
symplectic group, then there can be at most 2 positive cycles of length 
1). Similarly, there can be at most 1 negative cycle of length 1 (otherwise 
(r — 1)^, (T + 1)^ or (r^ -I- 1)^ divides the characteristic polynomial of any 
element of T^). □ 

The next result will be useful in analyzing the action of Sp{2n, q),q even 
on nondegenerate hyperplanes in the 2n + 1 dimensional orthogonal rep- 
resentation. Note that the stabilizers of these hyperplanes are orthogonal 
groups. 

Theorem 5.4. Let q be even. 

(1) The proportion of elements in Sp{2n, q) which are regular semisimple 
and fix a positive ( resp. negative ) type nondegenerate hyperplane is 
at most 1/2. 
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(2) The proportion of elements in Sp{2n, 2) which are regular semisimple 
and fix a positive (resp. negative) type nondegenerate hyperplane is 
at most the proportion of elements in Bn which have an even (resp. 
odd) number of negative cycles, at most one negative fixed point, and 
no positive fixed points or two-cycles. 

(3) The proportion of elements in Sp{2n, 4) which are regular semisimple 
and fix a positive (resp. negative) type nondegenerate hyperplane is 
at most the proportion of elements in which have an even (resp. 
odd) number of negative cycles, at most one positive fixed point, at 
most one positive two-cycle, and at most two negative fixed points. 

Proof. We view ^}{2n + l,q) = Sp{2n,q) and wc are asking whether we are 
in 0~^{2n,q) or 0^{2n,q). It is known that every element is in at least one 
of these (up to conjugacy) but a regular semisimple element is in precisely 
1 (since a regular semisimple element of Sp{2n,q) has no eigenvalue 1). 
Similarly, wc sec that each nondegenerate maximal torus stabilizes a unique 
nondegenerate hyperplane. 

The Tyj in are those in the type D subgroup of index 2 in the Weyl 
group and the rest arc in Q~ . 

So an upper bound for the number of regular semisimple elements in 

is 



Y,[G : N{T^)]\T^\ = Y,\G\\NiT^):T^\ 
weD 

= \G\J2\W:Cwiw)\ 

= |G|P|/|T^| = (1/2)|G| 

and so the probability that a random element of Sp{2n, q) is both regular 

semisimple and is in is at most 1/2 and similarly for 0~ (we just get 
those Tw with w not in the subgroup of index 2) - and in the limit as q 
increases, it does go to 1/2. 

If g = 2, one can do better because many tori will not contain regular 
semisimple elements. In particular, these include the maximal tori with any 
positive fixed points or two cycles or more than one negative fixed point. 

Similarly, (3) holds by noting that in Sp{2n,4), a maximal torus cor- 
responding to an element w in the Weyl group with 2 positive fixed points, 
3 negative fixed points or 2 positive two-cycles does not contain regular 
semisimple elements. □ 

For orthogonal groups, regular semisimple does not imply distinct eigen- 
values. We say an element in an n-dimensional orthogonal group is strongly 
regular semisimple if it has n distinct eigenvalues. Note that these ele- 
ments have the property that all invariant subspaces are precisely the same 
spaces invariant under the maximal torus containing it. If an element is just 
semisimple regular, the same remark holds for totally singular spaces. 
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Theorem 5.5. Let q be odd. Let G = Q,{2n + l,q). 

(1) The proportion of elements of G which are strongly regular semisim- 
ple and fix a nan- degenerate positive (resp. negative) type space of 
dimension 2k is at most the proportion of elements in i?„ which fix 
a k-set using an even (resp. odd) number of negative cycles. If q = 3 
the elements in can have no positive fixed points and at most one 
negative fixed point. 

(2) The proportion of elements of G which are semisimple and fi,x a 
nondegenerate 2k-space is at most the proportion of elements of Sn 
which fix a k-set. 

(3) The proportion of elements of G which are regular semisimple and 
fix a totally singular space of dimension k is at most the proportion 
of elements in Bn which fix a k-set using only positive cycles. 

Proof. Again, the Weyl group is the group of signed permutations. Keep 
notation as in the previous case. Then y = Vb-LVi_L..._LV^ where 
dimVo = 1, and dimVi = 2a j, with Ty^ acting irreducibly on if = — 1 
and acting irreducibly on a pair of totally isotropic subspaces of if e = + 
(the type of Vq is determined by the other V^). We argue exactly as above 
(note if the nondegenerate space has dimension 2k, we need = k for 
some subset, i.e. w preserves a k-sct). 

If g = 3, then a maximal torus containing regular semsimple elements 
implies that w has at most one fixed point of each sign. Similarly, if 
contains strongly regular semisimple elements, then w has no positive fixed 
points and at most one negative fixed point. 

For part (2), let x be semisimple. Suppose that x fixes a nondegenerate 
2k space. Then cither x is contained in a maximal torus T^ which fixes that 
2k space or det(x) = — 1 on the 2k space (and so on the complement as 
weh). 

Note that this implies that x has eigenvalues ±1 on the 2k space and an 
eigenvalue —1 on the orthogonal complement. Choosing a different nonde- 
generate 2k space that is x invariant where det(x) = 1 (by swapping the 
1-eigenvector and a —1 eigenvector) shows that x is conjugate to an element 
of T^, where w has cycles adding up to k, whence the result. 

The argument for totally singular k- spaces is exactly the same as the 
previous case. We need a j = A: for some subset of the aj all of positive 
type (ignoring the positivity, we get an upper bound of the proportion of 
elements in Sfi fixing a k-set). IZI 

We let Dn denote the group of signed permutations with the product of 
signs equal to 1; thus \Dn\ = 2"~^n!. 

Theorem 5.6. (1) Let q be odd. The proportion of elements of the 
group Q^{2n, q) which are strongly regular semisimple and fix a non- 
degenerate positive (resp. negative) type 2k-space is at most the pro- 
portion of elements of which fix a k-set using an even (resp. 
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odd) number of negative cycles. If q = 3, the element of has no 
positive fixed points and at most one negative fixed point. 

(2) Let q be even. The proportion of elements of Q~^{2n,q) which are 
regular semisimple and fix a nondegenerate positive (resp. negative) 
type 2k-space is at most the proportion of elements of Dn which fix a 
k-set using an even (resp. odd) number of negative cycles. If q = 2, 
the element of Dn has at most one positive fixed point, at most one 
negative fixed point, no positive two cycles, and at most one negative 
two cycle. If q = 4, the element of Dn has at most two positive fixed 
points. 

(3) The proportion of elements of Q,^{2n,q) which are semisimple and 
fix a nondegenerate 2k -space is at most the proportion of elements 
of Sn which fix a k-set. 

(4) The proportion of elements of Q'^{2n,q) which are regular semisim- 
ple and fix a totally singular k-space is at most the proportion of 
elements of Dn which fix a k-set using only positive cycles. 

Proof. So the Weyl group has order 2"~^n!, i.e. signed permutations with 
the product of the signs 1. If w corresponds to ai, ei, a,., e^, then V = 
Vi J- . . . J- Vr,dimVi = 2ai, where T^ is irreducible on if = — 1 and 
preserves a pair of totally singular spaces if Cj = 1. 

So Tyj preserves a nondegenerate 2k space if and only if "^cij = k for 
some subset, i.e. w fixes a k-set. 

Note that if g is strongly semisimple regular and it fixes a nondegenerate 
2fc-space, then the maximal torus T containing g will also fix that space. 
If q = 3 and contains strongly regular semisimple elements, has no 
positive fixed points and at most one negative fixed point. Now (1) follows. 

Suppose that q = 2. Then Ty^ contains semisimple regular elements im- 
plies that w has at most one fixed point of each type, no positive 2-cycles 
and at most 1 negative 2-cycle (corresponding to eigenvalues of order 5). 
Similar observations yield the statement about q = A and so (2) follows. 

If g is just semisimple and fixes a nondegenerate 2fe-space, it is not hard 
to see that g fixes some nondegenerate 2A;-space such that detg' = 1 on 
that 2A;-space. Thus, g is contained in a maximal torus fixing the second 
2A:-space, whence is a conjugate to an element of Tyj where fixes some 
nondegenerate 2fe-space (but not necessarily of the same type). Thus, w will 
fix a A;-subset and (3) follows. 

will preserve a totally singular k-space if and only if some subset of 
the positive cycles add up to k, proving (4). 

□ 

In the next result, we let D~ denote the nontrivial coset of Dn in Bn- 
Thus D^^ is the set of signed permutations with the product of signs equal 
to -1, and \D- \ = 2''-^n\. 
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Theorem 5.7. (1) Let q be odd. The proportion of elements of the 
group Q~{2n, q) which are strongly regular semisimple and fix a non- 
degenerate positive (resp. negative) type 2k-space is at most the pro- 
portion of elements of D~ which fix a k-set using an even (resp. 
odd) number of negative cycles. If q = 3, the element of D~ has no 
positive fixed points and at most one negative fixed point. 

(2) Let q be even. The proportion of elements of Q~{2n,q) which are 
regular semisimple and fix a nondegenerate positive (resp. negative) 
type 2k-space is at most the proportion of elements of D~ which fix a 
k-set using an even (resp. odd) number of negative cycles. If q = 2, 
the element of D~ has at most one positive fixed point, at most one 
negative fixed point, no positive two cycles, and at most one negative 
two cycle. If q = A, the element of has at most two positive fixed 
points. 

(3) The proportion of elements of Q~{2n,q) which are semisimple and 
fix a nondegenerate 2k-space is at most the proportion of elements 
of Sn which fix a k-set. 

(4) The proportion of elements of 0,^{2n,q) which are regular semisim- 
ple and fix a totally singular k-space is at most the proportion of 
elements of which fix a k-set using only positive cycles. 

Proof. The analysis is the same as in previous case. □ 

6. Large Fields 

We prove our main resuh in the case that q is large. We first note that by 
[FNPl IGuLub] it follows that the proportion of regular semisimple elements 
in a classical group is at least 1 — 0{l/q), where the implied constant is 
absolute. Indeed, the proof in [GuLub j actually shows the following: 

Theorem 6.1. Let S be a finite simple group of Lie type over a field of 
size q. Let g be an inner diagonal automorphism of S. The proportion 
of semisimple regular elements in the coset gS is at least 1 — 0{l/q). In 
particular, the proportion of regular semisimple elements in gS goes to 1 as 
q — )■ oo. 

Note that the same result applies if we replace 5 by a quasisimple group. 
The 0{l/q) error term is given quite explicitly in [GuLubj . One can give an 
alternate proof of this result by using generating functions. We next extend 
this to strongly semisimple regular elements in orthogonal groups. 

Theorem 6.2. Let S = n^id,q) = n^{V). Let g be an inner diagonal 
automorphism of S. The proportion of elements in the coset gS which are 
not strongly regular semisimple is at most 0{\/q). 

Proof. By the previous result, it suffices to consider semisimple regular el- 
ements which are not strongly regular. Let x be such an element. Then x 
is conjugate to an element of the subgroup J := SO{W) X SO{W^) where 
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X acts as ±1 on the nondegenerate 2-space W. The union of the conjugates 
of ah such elements for a fixed W has size at most 2\S\/{q — 1) (because 
this set is invariant under J). There are two different choices for W (either 
it has + type of — type). Thus, the proportion of elements in gS which 
are semisimple regular elements with a 2-dimensional eigenspace is at most 
4/(g — 1). The result follows. □ 

We next deal with a special case. 

Theorem 6.3. Let G = n^{2n,q) = n^{V). The probability that g £ 
G fixes a nondegenerate space of odd dimension k is at most 0{l/q) (the 
implied constant is independent ofn,k). 

Proof. Suppose that x £ SO{V) is semisimple and fixes a nondegenerate 
/c-space with k odd. Then x has an eigenvalue ±1 with multiplicity at least 
2 (and exactly 2 if x is semisimple regular). In particular, x is not strongly 
semisimple regular. Apply the previous result. 

□ 

Theorem 6.4. Let G be a classical group over a field of q-elements with 
natural module of dimension n. Fix a positive integer k < n/2. Let e > 0. 
There exists N > such that: 

(1) The probability that a random element of G fixes a nondegenerate 
subspace of dimension k is at most (2/3) + 0{l/q). 

(2) The probability that a random element of G fixes a totally singular 
subspace of dimension k is at most (1/2) + 0{l/q). 

(3) Lf n > 2k > N, the probability that a random element of G fixes 
a totally singular or nondegenerate subspace of dimension k is less 
than e + 0{l/q). 

Proof. By the remarks above, it suffices to compute the probability that a 
regular semisimple element fixes the corresponding type of subspace. By the 
previous section, this is bounded above by the proportion of elements in the 
Weyl group conjugate to a subgroup (or in the twisted cases a coset). Now 
apply the results of Sections [3l H] and [5] . □ 

Note that the same proof implies the same result for elements in each 
coset of the corresponding quasisimple group. In particular, we see that as 
g, fe — )• oo, the proportion of derangements goes to 1. 

7. Regular semisimple elements 

This section discusses estimates on the proportions of regular semisimple 
elements in the simple classical groups. In view of the results of the previous 
section, the case of q fixed is the critical case. The main result of this section 
are exact formulas for the fixed g, n — )■ oo limiting proportion of regular 
semisimple elements in the groups GL,U,Sp,n'^ (the case of GL is due 
independently to [F] . |Wa| and the cases U, Sp are in |FNP] ). The case of Q 
requires new ideas. 



DERANGEMENTS IN SUBSPACE ACTIONS OF FINITE CLASSICAL GROUPS 29 



We also discuss some closely related results about the asymptotic equidis- 
tribution of regular semisimple elements in cosets gH of a simple classical 
group in larger groups G. This gives a different approach to some results 
of Britnell [Bl] , |B2] (derived using generating functions) ; our approach has 
the advantage of generalizing to 0. 

The proportion of regular semisimple elements has also been studied in 
[F1J| : however their formulae do not seem easily suited to asymptotic anal- 
ysis. 

7.1. SL. Theorem 17.11 gives the fixed q, large n limiting proportion of regular 
semisimple elements in GL{n,q). This result will be crucial in this paper. 

Theorem 7.1. (|F]. [Wa| j The fixed q, n — )• oo limiting proportion of regular 
semisimple elements in GL{n,q) is 1 — 1/q. 

Using algebraic geometry Guralnick and Liibeck established the following 
result (which can be proved less conceptually using generating functions). 

Theorem 7.2. i^ jGuLubj ) The proportion of regular semisimple elements 
in PSL{2, q) is at least 1 — (2, g — '\.)/{q — 1). For n > 3, the proportion of 
regular semisimple elements in PSL{n, q) is at least 1 — l/(g — 1) — 2/(g — 1)^ . 
In particular, as q ^ oo, these proportions go to 1 uniformly in n. 

As we have noted, the same is true for any given coset of PSL (with the 
same proof). The following result was proved by Britnell using generating 
functions. 

Theorem 7.3. (|BT]J The fixed q, large n limiting proportion of regular 
semisimple elements in any coset of SL{n, q) in GL{n, q) is equal to 1 — 1/q 
(the corresponding limit for GL{n,q)). Furthermore the same holds for a 
GL{n,q) coset of any subgroup H between SL{n,q) and GL{n,q). 

Although generating function methods lead to the most precise bounds, 
we use the relationship between maximal tori and the Weyl group (Section 
E]) to obtain a different proof of Theorem 1 7. 31 This approach will be useful in 
studying in odd characteristic (where generating function methods seem 
difficult). 

Theorem 7.4. Let H be a subgroup between SL(n,q) and GL{n,q). The 
difference in the proportion of regular semisimple elements in any two cosets 
of H in GL(n,q) is at most -^-^yj^^j where Cq is independent of n. 

Proof. One can suppose that H = SL{n,q) since cosets of other subgroups 
are unions of cosets of H and we are supposing q is fixed. Let be a 
maximal torus of GL{n,q). Suppose that w has r distinct cycle lengths 
oi,--- , Or occurring with multiplicities mi,-- - ,mr and set bi = airrii so 
that the sum of the bi is n. 

We claim that if gcd(aimi, - - - ,armr,q — 1) = 1, then the number of 
regular semisimple elements of T^ is the same for each coset. To see this. 
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choose scalars ci,-- - , such that ]^c"""' = C where C is a generator of 
the multiphcative group of F* (the gcd condition guarantees that this is 
possible). Write t G as (ti, • • • ,tr) where the U correspond to the cycles 
of length Oj (and so there are rrii blocks). Then define a map i— )• by 
sending (ti,--- ,tr) to (citi,--- ,Crtr)- This multiplies the determinant by 
C and is a bijection on regular semisimple elements. (All we need to verify 
is that if (ti, • • • ,tr) is regular semisimple so is (citi, • • • , c^tr)- Since the 
minimal polynomials of distinct ti have all factors of degree aj, it is clear that 
Citi and Cjtj have relatively prime minimal polynomials. Since the minimal 
polynomial of ti is the same as its characteristic polynomial, the same is 
true for Cji,, whence the claim). 

Call a conjugacy class C of Sn bad if permutations w in it do not satisfy 
the condition gcd{aimi, ■ ■ ■ ,armr,q — 1) = 1. We want to upper bound 
\f — g\ where f,g are the proportion of regular semisimple elements in two 

IT 

fixed cosets. Since each intersects each coset in elements, and there 
are \GL{n,q)\/\N{Tiu)\ maximal tori of type w, it follows by the method of 
Section [5] (see for instance the proof of Theorem 15. ip that 

|f_ I < 1 V \GL{n,q)\\T^\ 1 

1-^ \SL{n,q)\/^jN{T^)\{q-l)- \Sn\ ' 

C bad 

The result now follows from Theorem 13. 1U[ □ 

To conclude this subsection, we derive upper bounds (which will be used 
in Section [9|) for the number of regular semisimple elements in GL(n,2), 
GL{n,A) and GL(n,9). 

Lemma 7.5. /"[Lej ) The number of regular semisimple conjugacy classes in 
GL{n,q) ^s2^(g- -(-!)-). 

Theorem 7.6. (1) For n > 1, the proportion of regular semisimple el- 
ements in GL{n,2) is at most 5/6. 

(2) For n > 1, the proportion of regular semisimple elements in GL(n, 4) 
is at most 6/7. 

(3) For n > 1, the proportion of regular semisimple elements in GL{n, 9) 
is at most 83/91. 

Proof. First consider the case of GL{n, 2). The reasoning of Section[5]implies 
that the proportion of regular semisimple elements in GL(n, 2) is at most 
the proportion of elements in Sn with at most 1 fixed point. From the cycle 
index of the symmetric groups, the proportion of permutations with at most 
one fixed point is the coefficient of in ^irp3^- This is easily seen to be 
at most 5/6. 

For parts 2 and 3 a different method is used. First consider the case of 
GL{n, 4). Suppose that n is even. The number of conjugacy classes of cyclic 
elements of GL{n, q) (i.e. elements where the characteristic polynomial is 
equal to the minimal polynomial) is precisely {q — l)q"'~^, the number of 



DERANGEMENTS IN SUBSPACE ACTIONS OF FINITE CLASSICAL GROUPS 31 

characteristic polynomials of elements of GL{n,q). Hence by Lemma 17.51 
there are 3(4""-'^) — '^^^^ ^'^ many cyclic conjugacy classes of GL{n,A) which 
are not regular semisimple. By Corollary 2.3 of |NP2| . the number of matri- 
ces in GL{n, q) which are cyclic and with a given characteristic polynomial 
is at least '^^^^f (independent of the polynomial). Thus for n even, the 
proportion of regular semisimple elements in GL(n, 4) is at most 

"3(4"-!) 3" 



1 



1 5 



< 6/7. 



The case of n odd is similar (the upper bound is 6/7 for n = 3). We omit the 
details for GL(n, 9) which are similar. □ 

7.2. SU. This subsection considers proportions of regular semisimple ele- 
ments in the unitary groups. Recall that N(q; d) and M{q; d) were defined 
in Section [2j 

Theorem 7.7. ^ [FNP] ) 

(1) The fixed q, n ^ oo proportion of regular semisimple elements in 
U{n, q) ^s (1 + l/q) \{, ,,,(1 - ^^^^'^^''^^ 

(2) The fixed g, n — )• oo proportion of regular semisimple elements in 
U (n, q) is at least I — l/q — 2/q'^ + 2/q'^. For q = 2 it is at least .414, 
for q = 3 it is at least .628, and for q > 4 it is at least .72. 

Using algebraic geometry, Guralnick and Liibeck established the following 
result. 

Theorem 7.8. /'[ GuLubj ) For n > 2, the proportion of regular semisimple 
elements in PSU{n,q) is at least 1 — l/(g — 1) — 4/(q — 1)^. In particular 
as g —7- oo this goes to 1 uniformly in n. 

The following result is due to Britnell. 

Theorem 7.9. (|B2]J The fixed q, large n limiting proportion of regular 
semisimple elements in any coset of H = SU{n,q) in U{n,q) is equal to the 
corresponding limit for U{n,q). Furthermore the same holds for a coset of 
any subgroup H between SU{n,q) and U{n,q). 

Theorem 17.101 is an analog of Theorem 17.41 for the unitary groups. 

Theorem 7.10. The difference in the proportion of regular semisimple el- 
ements in any two cosets of SU{n,q) in U{n,q) is at most ^^^°f/"^ , where 
Cq is independent of n. 

Proof. The proof is essentially the same as that of Theorem 17.41 The group 
of possible determinants is the size q-|-l subgroup of the multiplicative group 
of F^2, so (using the notation of Theorem [73]), the condition for a conjugacy 
class of Sn to be bad is that gcd{aimi, • • • , Ornir, q + I) ^ 1. □ 

The following estimates will be useful. 
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Theorem 7.11. (1) For n > 2, the proportion of regular semisimple 
elements in U (n, 2) is at most .877. 
(2) For n > 2, the proportion of regular semisimple elements in U{n, 3) 
is at most .94. 

Proof. Using the cycle index of the unitary groups and Lemma [2. 71 one sees 
that the proportion of elements in U{n, q) in which the polynomial {z — 1) 
occurs with multiplicity 2 is the coefficient of in 



+ 



q^il + l/q){l-l/q2) qHl + l/q) 
1)1-^1H J 



u^q 



'-y 

1)1 -u^ 



i>l 

2 - oo 



u~q i (-1)^ 2 'u"- 



(g2 - l){q + 1) 1 _ u ZL. (g + l)(g2 _ 1) . . . (^n _ (_l)n) " 



Hence the coefficient of is at least 



(g2 _ + 1) + l)(^2 _ 1) . . . _ 



Substituting q = 2 and (7 = 3 proves the result. □ 

7.3. Sp. This section considers the proportion of regular semisimple ele- 
ments in the symplectic groups Sp{2n,q). 

Theorem 7.12. i^ |FNPj ) Let f = 1 if the characteristic is even and f = 2 
if the characteristic is odd. 

(1) The fixed g, n — )• oo proportion of regular semisimple elements in 
Sp{2n, q) is 

(2) The proportion of part 1 is at least .283 for q = 2, at least .348 for 
q = 3, at least .453 for q = A, at least .654 for q = 5, at least .745 
for q = 7 , at least .686 for q = 8, and at least .797 for q > 9. 

As with the other groups, there is an important result due to Guralnick 
and Liibeck. 

Theorem 7.13. f ]GuLubj ) For n>2 the proportion of regular semisimple 
elements in Sp{2n, q) is at least 1 — 2/(g — 1) — l/(g — 1)^. In particular, as 
g — )■ oo, this goes to 1 uniformly in n. 

The following bound will be useful. 
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Theorem 7.14. For n > 1, the proportion of regular semisimple elements 
in Sp{2n, q) is at most .74 for g = 4, at most .80 for q = 5, at most .86 for 
q = 7, and at most .88 for q = 8. 

Proof. If an element of Sp{2n, q) is regular semisimple, then its z — 1 com- 
ponent is trivial. From the cycle index of the symplectic groups, this occurs 
with probability equal to the coefficient of n" in 

n.>i(i-vg^--^) 

l-u 

This in turn is equal to 

n 

^Coef. in 

r-=0 i>l 

By part 1 of Lemma 12. 7( this is at most 

which yields the theorem. □ 

7.4. Q. This subsection considers proportions of regular semisimple ele- 
ments in the simple groups Vt^{n,q). Since il(2n + l,q) is isomorphic to 
Sp{2n, q) when q is even, throughout this section we disregard this case. 

We recall the characterization of regular semisimple elements in Q (note 
that for the other classical groups, regular semisimple is equivalent to having 
minimal polynomial equal to the characteristic polynomial). 

Lemma 7.15. An element of Q^{n,q) is regular semisimple if and only if 
the characteristic polynomial is squarefree except for the (zitl) terms, which 
can have multiplicity 0, 1 or 2 (and in the multiplicity 2 case, the zit 1 piece 
of the vector space is the direct sum of two 1 dimensional invariant spaces). 

We now focus on the case of q fixed. We begin with the case of q even. 
Recall that J7^(2n, q) is defined as the index 2 subgroup of 0^(2n, q) whose 
quasideterminant is equal to 1. (Letting dim(/ix) denote the dimension 
of the fixed space of a matrix, the quasideterminant of a is defined as 

(^_l)dim(/ix(o))-j^ 

The following lemma will be helpful. 

Lemma 7.16. The dimension of the fixed space of a matrix a is the number 
of parts in the partition corresponding to the polynomial z — 1 in the rational 
canonical form of a. 

From Lemma [7.16l and the cycle index for the orthogonal groups in [F], it is 
clear that the cycle index of is obtained from the cycle index of simply 
by imposing the additional restriction that the partition corresponding to 
the polynomial z — 1 has an even number of parts. We proceed to do this 
for the case of regular semisimple elements. 
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Let rsQ± (2n, q) denote the proportion of regular semisimple elements in 
0^(2n, g). Let RSq±{u) be the generating function defined by 

RSn±iu) = l + ^u'' ■rsn±i2n,q). 

Theorem 17. 171 gives expressions for RSq± . For its statement we need some 
definitions. Letting rsspC^n, q) denote the proportion of regular semisimple 
elements in Sp{2n,q), define the generating function RSsp{u) by 

RSspiu) = 1 + ^ • rsspi2n, q). 

n>l 

This second generating function was considered in [FNP] . Also define, as in 
[FNP] 



M*{q;d) 



^o(-) = n(i-?Vr'"'"""n(i + 3tT: 

d>l ^ d>X ^ 

Theorem 7.17. Suppose that q is even. 
(1) 



(2) 

(11 11 \ 

Proof. The proof runs along the lines of results of |FNPj but two additional 
points should be emphasized. First, the factors of two on the right hand side 
come from the fact that is an index 2 subgroup of when the charac- 
teristic is even. Second, Lemma 17.151 forces the partition coming from the 
z — 1 component of a regular semisimple element to be one of (0), (1), (1, 1). 
The choice (1) is ruled out since this partition must have even size since 2n 
is even. Thus the partitions must be (0) or (1,1). In the second case one 
must take care to consider +, — types. The term 2{q^i) ^^ises from + type 
and the term 2[(^+i) arises from — type. □ 

Corollarv 17. 181 calculates the fixed q, large n limiting proportion of regular 
semisimple elements in Q^{2n, q) in terms of the corresponding proportions 
in Sp{2n,q), which were discussed in the previous subsection. 

Corollary 7.18. Suppose that q is even. Then 

lim rsQ+{2n,q) = lim rs^-{2n,q) = ( 1 + , ) lim rssp{2n,q). 

n— ^-oo n— >oo \ q'^ — 1 y n— >oo 

Proof. First we claim that 

lim {rsQ+ {2n, q) + rs^- {2n, q)) = 2 ( 1 + J' ] lim rssp{2n, q). 

n— >-oo \ q^ — 1 / n— >-oo 
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This follows from Lemma 12.91 and from the facts that (1 + 2{ii-i) ~^ 2{q+i) ) 
is analytic in a circle of radius greater than 1 and that (1 — u)RSsp{u) is 
analytic in a circle of radius greater than 1 ( |FNPj ). Next we claim that 

lim (rSf^+(2„,q) - rSQ~^2n,g)) = 0. 

This follows from the result in [FNP] that the n — )• oo limit of the coefficient 
of in Xo(u) is 0. □ 

Next we consider the case of q odd. First, we derive the large n limiting 
proportion of regular semsimple elements in SO^. Then it is proved that 
these proportions are equal to the corresponding proportions for f]^. 

Theorem 7.19. Suppose that q is odd. The n — t- oo proportion of regular 
semisimple elements in S0{2n + l,q) is (1 + ^53^) multiplied by the corre- 
sponding limiting proportion in Sp{2n,q). By Theorem \7.1S\ this is at least 
.478 for q = 3 and at least .790 for q > 5. 

Proof. An element of SO{2n + l,g) is regular semisimple if and only if 
all polynomials other than 2; it 1 occur with multiplicity at most 1, the 
polynomial z — 1 occurs with multiplicity exactly 1, and the polynomial 
z + l occurs with multiplicity or 2 (and in the latter case the z + 1 piece of 
the underlying vector space decomposes as the direct sum of two invariant 
1 dimensional subspaces). Letting rssoC^^ + 1)0') denote the proportion of 
regular semisimple elements in S0{2n + l,q), it follows from the reasoning 
of jFNPj and the fact that 50+ (2n + 1, g) is isomorphic to SO-{2n + l,q) 
that 

1 + Vti"TS5o(2n + l,( 



n>l 

Yl Y ^''^'^^^ (2n + 1, g) + rsso- (2n + 1, g)) 

n>l 



n>l 

The term (1 + 2{il^-i) + 2{q+i) ) corresponds to the z + l piece of the char- 
acteristic polynomial of the element, the term (1/2 + 1/2) corresponds to 
the z — 1 piece, and the term RSsp{u) arises from the other factors of the 
characteristic polynomial. The theorem now follows from Lemma 12.91 since 
(1 — u)RSsp{u) is analytic in a circle of radius greater than 1. □ 

As in Section [5l we say that an element of an n-dimensional orthogonal 
group is strongly regular semisimple if it has n distinct eigenvalues. Arguing 
as in Theorem 17.191 proves the following result. 

Theorem 7.20. Suppose q is odd. The n — )• 00 proportion of strongly regu- 
lar semisimple elements in SO{2n + is equal to the n — )■ 00 proportion 



of regular semisimple elements in Sp{2n, q). By Theorem 7.12 this is at least 
.348 for q = 3 and at least .654 for q > 5. 
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For even dimensional orthogonal groups, one has the following results. 

Theorem 7.21. Suppose that q is odd. The n — t- oo proportion of regular 
semisimple elements in SO^{2n,q) is (1 + multiplied by the corre- 

sponding limiting proportion in Sp{2n,q). By Theorem \7.1S\ this is at least 
.657 for q = 3 and at least .954 for q > 5. 

Proof. An element of SO^{2n,q) is regular semisimple if and only if all 
polynomials other than z ± 1 occur with multiplicity at most 1, and the 
polynomials z ±1 occur with multiplicity or 2 (in the multiplicity 2 case 
the piece of the vector space with characteristic polynomial z it 1 is a sum of 
1 dimensional invariant spaces). Let rsgQ±{2n,q) denote the proportion of 
regular semisimple elements in S0^{2n,q). The reasoning of [FNPJ implies 
that 



l + '^u'' ( ^^SO+{'^n,q) ^ rsso-{2n,q) \ 

n>l V 2 2 ) 

The result now follows from Lemma 12.91 since (1 — u)RSspiu) is analytic in 
a circle of radius greater than 1, and 

lim rsso+{'^n,q) = lim rsso-{'^n,q) 
n— >cxD n— )-cxD 

by a generating function argument similar to that of Corollary 17.181 □ 

Theorem 7.22. Suppose q is odd. The n — )• oo proportion of strongly 
regular semisimple elements in SO^(2n, q) is equal to the n — )• oo proportion 



of regular semisimple elements in Sp{2n, q). By Theorem \7.1^ this is at least 
.348 for q = 3 and at least .654 for q > 5. 

Lemmas 17.231 and 17.241 will be useful in reducing from to SO^ in odd 
characteristic. 

Lemma 7.23. The n — )• oo limiting proportion of elements in Bn where all 
even length negative cycles occur with even multiplicity is 0. 

Proof. Recall the notation / << g from Subsection 12.31 By the cycle index 
of the hyperoctahedral groups, the proportion of elements of B^ in which 
all even length negative cycles have even multiplicity is the coefficient of 
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m 



n n E 



u 



i odd i even \i^0> even 



E ■ 

odd i even even 



:2.)i2^V2(j/2)! 



nil* T r 3il_i_"^' 

i odd i even 
1 T-r 

= I I e 2i _ 

(1-n) -IJ- 

It follows from Lemma 12.91 that as n — t- oo, the coefficient of in this 
expression goes to 0. □ 

Lemma 7.24. Let q be odd. Then the spinor norm 6{t) of an involution 
t in SO^{n,q) depends only on its —1 eigenspace which has dimension 2d 
and is of type e. More precisely, 9{t) is trivial if and only if e = + and d is 
even or d is odd and e is a square modulo q. 

Proof. Write V = Vi -L V2 where Vi is the fixed space of t. Clearly, 
6(t) = 6{t\v2)- Write V2 as an orthogonal sum of d copies of two dimen- 
sional subspaces. Note that if two of the summands are of the same type, 
then t restricted to the sum of those two summands has spinor norm 1 (since 
it will be a square). So we are reduced to considering the 2 and 4 dimen- 
sional cases (corresponding to d odd and d even). If d is odd, then the spinor 
norm is trivial if and only if 4|(g — e). While if d is even, the spinor norm 
will be trivial if and only if each of the two summands has the same type, 
whence the result. □ 

Now we can prove the following result. 

Theorem 7.25. Let q be odd. 

(1) The large n limiting proportion of regular semisimple elements in 
r2(2n + l,q) is equal to the corresponding limiting proportion in 
S0{2n + l,q), and the difference between these proportions for a 
given n is bounded independently of q. 

(2) The large n limiting proportion of regular semisimple elements in 
r2^(2n,q) is equal to the limiting proportion in SO^{2n,q), and the 
difference between these proportions for a given n is bounded inde- 
pendently of q. 

(3) The large n limiting proportion of strongly regular semisimple ele- 
ments in Vt{2n+\, q) is equal to the corresponding limiting proportion 
in S0{2n + l,q), and the difference between these proportions for a 
given n is bounded independently of q. 
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(4) The large n limiting proportion of strongly regular semisimple ele- 
ments in i7^(2n, q) is equal to the limiting proportion in SO^{2n, q), 
and the difference between these proportions for a given n is bounded 
independently of q. 

Proof. For the first part of the theorem, the group in question is S0{2n+1, q) 
and has Weyl group the hyperoctahedral group each w corresponds to 
a product of signed cycles. Let Tyj be a maximal torus in G and decompose 
the space according to w; i.e. it is an orthogonal sum of a trivial 1-space 
and a space of even dimension 2di and either is irreducible on the 2di 
space (which is therefore of - type) or the space is of + type and the space 
splits as a direct sum of 2 subspaces of dimension di and acts dually 
on them. Join together the spaces of the same type (the "homogeneous" 
components)- that is where the diS are equal and given that the type is the 
same. Note that the the characteristic polynomials of regular semisimple 
elements on different homogeneous pieces are relatively prime and thus one 
can treat each piece separately. 

So suppose we have a homogeneous piece where the dimension is 2d of 
type e and multiplicity m. We seek an element s in such that s has 
nontrivial spinor norm and if t is in Tyj , then st is regular semisimple if and 
only if t is (for then this is a bijection between regular semisimple elements 
in with trivial and nontrivial spinor norm). 

By Lemma EMI such an element exists provided that corresponds to 
a conjugacy class of signed permutations w such that at least one of the 
following holds: 

(1) There is an even length negative cycle which occurs with odd mul- 
tiplicity. 

(2) There is an odd cycle length > 1 with odd multiplicity and negative 
type and q = 1 mod 4. 

(3) There is an odd cycle length > 1 with odd multiplicity and positive 
type and (7 = 3 mod 4. 

Call w good it if satisfies any of these properties. From Lemma 17.231 it 
follows that almost all elements in the Weyl group are good (and in particular 
satisfy the first property), so by the method of Theorem l7.4t the difference in 
the proportion of regular semisimple elements in the two cosets of rt{2n+l, q) 
is at most the proportion of elements w not satisfying the above properties, 
so this goes to as ra — )• oo, uniformly in q. 

For the second part of the theorem one must work in D„ rather than 
but any of the 3 conditions in the first part still ensure that the conjugacy 
class is good so the result follows by a minor modification of Lemma 17.231 

Parts (3) and (4) follow by precisely the same argument (indeed the es- 
timate can only get better since we only need consider maximal tori which 
contain strongly regular semisimple elements and the construction above 
still takes strongly regular semisimple elements to strongly regular semisim- 
ple elements). □ 
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8. Nearly regular semisimple elements 



This section proves that with high probabihty, an element of a finite 
classical group is regular semisimple on a space of small codimension. More 
precisely, the following result is established. 



Theorem 8.1. Let G be one of GL{n,q), U{n,q), Sp{2n,q), or 0^{n,q). 
Then there are universal constants ci,C2 such that for any r > 0, the proba- 
bility that an element of G is regular semisimple on some subspace of codi- 
mension < ci + r is at least 1 — C2/r^. 



As the proof of Theorem 18.11 will show, values of the constants ci,C2 
can be worked out though it is tedious and not necessary for the present 
paper. For example we prove that when G = GL{n,q), one can take ci = 
-7- — , , — TT-TToTi which is at most 28 since q > 2. 

<?(l~l/i?) (1-1/9 ) ~ 



Proof. We give full details only for GL(n,q), but indicate what changes are 
needed for the other groups in the statement of the theorem. 

For G = GL, U or Sp, let D{a) be the sum of the degrees (counting 
multiplicity) of the irreducible factors of the characteristic polynomial of 
a € G which occur with multiplicity greater than one. For G = O, let D{a) 
be the sum of the degrees (counting multiplicity) of the irreducible factors of 
the characteristic polynomial oi a € G which occur with multiplicity greater 
than one and of the irreducible factors corresponding to zitl; the only reason 
for the different definition in the orthogonal case is to simplify the generating 
function. Our strategy is to upper bound the expected value and variance 
of D{a) and to then apply Chebyshev's inequality, which states that for 
any random variable X with mean fi and variance cr^, the probability that 

2 

|X — /x| > o is at most 

Using the partition notation in Subsection 12.11 one sees that the gener- 
ating function for the random variable D on GL{n, q) in the variable t is at 
most the coefficient of u"' in 



HE 



(ut) 



d\X\ 



d>l 



+ 



^d^d 



N(q;d) 



By Lemma 12.61 this is equal to 



F{u,t) 11(1 



u'^t'^, 

nid ' 



+ 



U 



d>l \i>l 



^d^d 



N{q;d) 
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To compute the expected value of D, one differentiates witli respect to t and 
then sets t = 1. Doing this gives the coefficient of in 



d>l i>l ^ 

\i>l ^ 
It is straightforward to see that 



qd_i qd _i 



t=l 



d/dt n(i - -id)-' + 



^d^d 



A>1 



qd -I qd -I 



Y\S-^ qid) qjd) qjd 



t=i 



Thus the expected value of D is the coefficient of vP' in 



-N{q;k) 



d>l 



k>l i>l 



qjd) qjd 



n a 
i^--rd 



Using part 1 of Lemma 12.51 and Lemma 12.71 this simplifies to the coefficient 
of n" in 



d>l 



Eu'^ , 1 du'^ 1 -i-r , a , 

^^-7J-d) 7Jd\-Il(^-7:rd) 



i>l 



du'^ 
q'^ - I 



dN{q;d) 

d>l 



u 



/L^ /L^ gjdr a'^ — 1 

j>l r>l ^ r>l ^ 



,dr 



-^qd-l (qd{r-l) _ 1) . . . (gd _ 1) 



d>l 



dN{q; d) 



u 



qdr _i qd_i 



u 



dr 



r>l 



J—^dN{q;d)Y, 

d>\ r>2 



U 



r>l 
dr 



(gd(r-l) _ 1) . . . (gd _ 1) 



+ 



i-iy 



,dr 



1 - 1 {qd{r-l) _ 1) . . . (gd _ 1) 



Note that the r = 1 term has canceled, which is crucial. Using the bound 
dN(q; d) < q'^, and the notation / << g from Section \T3\ one sees that the 
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mean of D is at most the coefficient of in 



<< 



<< 



d>l r>2 



~,dr 



U'^'' 1 
+ 



u 



dr 



1 [q<^ - I) {qd{r-l) - I) . . . {qd - I) ^ 



d>l r>2 
2 



dr 



dr 



^ '^^ d>l r>2 

(1 \ ^ 1 - u"^ 
1 - 1/fl ) ^X]^ 



m>2 r|m 

r>2 



This is at most 



g(l-l/g)3(l- 1/^1/2) 



< 28 



for q >2. 

To finish the proof for GL{n, q), we sketch an argument that a (the vari- 
ance of D) is finite, and bounded independently of n and q. It is convenient 
to define 

5(u,i,d) = n(l-^)"' + 



i>l 



qd - I qd - I 



Observe that the expected value of D(D — 1) is 



didi 



t=i 



IE 



^ S{u,t,d) dt 



t=i 



We know from Lemma 12.51 that -F(n, 1) = and that the coefficient of 

in ^F{u,t)t=i is bounded by a constant independent of n,q (this was the 
computation of the mean of Z?). Combining this with an analysis of the first 
and second derivatives of S{u,t,d) at t = 1 (using part 2 of Lemma I2.7P 
proves the result. The essential point (as in the computation of the mean of 
D) is that the coefficient of in S{u, t, d) vanishes. 

For the case of the unitary groups, one sees that the generating function 
for the random variable D on U{n,q) in the variable t is the coefficient of 
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N(q;d) 




n n(i+ 

d>l \i>l 



■ n n 

d>i \i>i ^ 

For the case of the symplectic groups, one sees that the generating func- 
tion for the random variable D on Sp{2n, q) in the variable t is the coefficient 
of u" in 

N*{q;2d) 

„,d „,d+d \ 

^1 



ut 




q2r-l 



where / = 1 if the characteristic is even and / = 2 if the characteristic is 
odd. The orthogonal groups are similar. 

What makes these generating functions tractable is that they involve 
many products. To compute the mean of D it is feasible to use the product 
rule to differentiate it with respect to t and then set t = 1. To carry out the 
program as for GL, one uses Lemma [2.5|, 12.71 and the expressions for N[q] d), 
M{q;d), N*{q]d), and M*{q;d) in Subsection 12.21 The computation of the 
variance of D runs along the same lines. □ 

9. Main results: proportion of derangements in subspace 

ACTIONS 

This section proves the main results of this paper; these can be subdi- 
vided into two types of results. The first set establishes the Boston-Shalev 
conjecture in the case of subspace actions: we show that for a primitive 
subspace action of a simple classical group G with \G\ sufficiently large, the 
proportion of derangements is at least 6 > .016 (and often much better). 
The second set of results shows that when the dimension and codimension 
of the subspace grow to infinity, the proportion of derangements goes to 1. 
Moreover, in both cases we give some results for proportions of derange- 
ments in cosets of simple finite classical groups H in groups G with G/H 
cyclic. By the results of Section [6l it suffices to take q fixed and we do so 
for the rest of the section. 

9.1. SL. Recall that we are dealing with asymptotic results: thus the order 
of the group goes to infinity. This subsection considers the action of GL{n, q) 
and cosets of SL{n, q) in GL{n, q) on k dimensional subspaces. Throughout 
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we suppose that 1 < k < n/2, as the actions on k spaces and n — k spaces 
are isomorphic. 

First, we show that for any fixed A; (1 < A; < n/2), the proportion of 
derangements on /c-spaces is uniformly bounded away from 0. Theorem 19.11 
reduces to the case that G = GL{n,q). 

Theorem 9.1. Let gSL{n,q) be a coset of SL{n,q) in GL{n,q). For k 
fixed, q fixed, and n — t- oo, the proportion of elements of gSL{n, q) which are 
derangements on k-spaces is equal to the proportion of elements of GL{n,q) 
which are derangements on k-spaces. 

Proof. Note that whether an element fixes a k-space depends only on the 
cycle index data corresponding to irreducible polynomials of degree at most 
k. We prove that for any such property, the n — t- oo proportion of elements 
which satisfy it is the same in any two cosets of SL{n, q). The argument is 
inspired by generating function techniques of Britnell [Bl] . 

First we recall Britnell's notation. Let ^q-i denote the group of complex 
q — 1 roots of unity, and let be a generator of ^q-i- For /3 G F* define r(/3) 
to be the element of {0, 1, • • • ,q — 1} so that (^"^(^^ = /3. For a polynomial 
/ define t(/) = r((— 1)'^^^^''')/(0)). As explained in [Bl], the cycle index for 
the coset of SL{n, q) consisting of elements of determinant fi is given by 

/, ,Ta)|AU ,,deg((A)|A| \ 

where C(f,^\ is the centralizer size of an element of GL{n, q) with Jordan 
form data {A^} (a formula for this centralizer size was reviewed in Subsection 
12. ip . Here S^^i is equal to 1 if /i = 1 and otherwise. The term corresponding 
to (J = 1 gives the cycle index of GL{n, q). Thus it is necessary to show that 
the large n coefficient of in terms corresponding to a; ^ 1 go to 0. Since 
whether an element fixes a k-space depends only on the cycle index data 
corresponding to irreducible polynomials of degree at most k, it is enough 
to show that the coefficient of n" in 

/^rW|A|^dcgW|A|\ 

A{u,u) n E — — — 

(t>:deg{<f,)>k A \ ''''^ / 

goes to as n — )• oo (here A{u, co) is a term corresponding to possible Jordan 
forms for the polynomials of degree at most k) . By Lemma 12.61 for uj ^ 1 
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this is equal to 



A{u,u:) n n 1 

(/>:deg((^)>fc ■t>l V 
(t>:dez{<t>)<ki>l \ 

A[u,^) n nfi 

0:deg((/))<fc t>l V 




qi-deg{<p) j ±111 \ gi-deg{(f>) 

ltdcg((/>)^T((/)) 

a«-deg((/)) 



where the final equality is because the characteristic polynomial of a random 
element of GL{n, q) has its constant term equidistributed over F* (alterna- 
tively, the final equality follows from Identity 3.4 of [Blj). 

Recall the notation f « g from Subsection 12.31 Using the fact from 
Lemma 12.61 that 



()!):deg((/))<fc i>l 



it follows that 



^K^) n n 1 



0:dcg((^)<fci>l 



qi deg((/)) 



<< 



-|-r TT 1 + /g^-'^'=S(</') ^ 

11 ^ 11 [ 1 _ udeg{<l>) /qi-degW 



(f>:deg{<j))<k i>l 



1111 I 1 - n'^/g*'^ 



d=l i>l 



« 



nn \ — lid I nid 



d=li>l ^ 



where N[q] d) was defined in Section [2j Since k is fixed, this expression is 
analytic in a circle of radius greater than 1. Thus by Lemma 12.91 t^is large 
n coefficient of in this expression goes to 0. □ 

The large n limiting proportion of eigenvalue free elements in GL{n, q) 
(i.e. derangements on 1-spaces) was calculated by Stong. An asymptotic ex- 
pansion of this limiting proportion (but not an explicit lower bound) appears 
in [NP] . 

Lemma 9.2. (1) f |Stj ) The fixed (7, n — )• oo limit of the proportion of 
eigenvalue free elements in GL{n,q) is equal to ni>i(l ~ l/g*)'^^^. 
(2) a>i(l-l/'70''"' > l/4/or<7>2. 
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Proof. The first part is due to Stong, so we only prove part 2. By the 
inequality log(l — x) > —x — for < x < 1/2, it follows that 



log I na - 1/9T-M > ('?-i)E 

^i>l j i>l 

1 



1 1 



Q 

> -4/3 



This implies the result as e~^/^ > 1/4. □ 

Theorem 9.3. Suppose that 1 < k < n/2 is fixed. For \SL{n, q)\ sufficiently 
large, the proportion of elements in any coset gSL(n, q) of GL(n, q) which 
are derangements on k-spaces is at least 1/16. 

Proof. Recall that we are taking fixed q, as large q was handled in Section 
[6l By Theorem 19.11 it is sufficient to work with GL{n,q). Theorems 15.11 
and 13.21 imply that the proportion of elements of GL{n, q) which are regular 
semisimple and fix a fe-space is at most 2/3. Hence Theorem 17.11 gives that for 
q > 4:, the proportion of elements of GL{n, q) which are regular semisimple 
and derangements on /c-spaces is at least 3/4 — 2/3 > .08. For g = 3, A; = 1 
the result follows from Lemma 19.21 For q = 3,k > 2, Theorem 15.11 and 
Lemma 13.71 imply that for n sufficiently large the proportion of elements in 
GL{n, q) which are regular semisimple and derangements on /c-spaces is at 
least 1/16 since 1/16 < (2/3) - (3/5) = 1/15. 

Finally we consider the case q = 2. When = 1 it follows from Lemma 
19.21 that the large n proportion of derangements of GL{n,2) on 1-spaces is 
at least 1/4. Suppose that k > 2. Let H C GL(n,2) be a stabilizer of a 
/c-space. The proportion of regular semisimple elements in H is at most the 
product of the proportions of regular semisimple elements in GL{k, 2) and 
GL(n — k, 2). The former proportion is at most 5/6 by Theorem 17.61 and and 
the latter proportion goes to 1/2 as n — )• oo by Theorem 17. 11 It is easily seen 
that the proportion of elements of GL{n, 2) which are regular semisimple 
and fix a fc-space is at most the proportion of elements of H which are 
regular semisimple. (Indeed, the proportion of elements of GL{n, 2) which 
are regular semisimple and fix a A;-space is at most the number of conjugates 
of H multiplied by the number of regular semisimple elements of and then 
divided by |GL(re, 2)|. Since H is maximal in GL(n, 2) and not normal, the 
number of conjugates of H is equal to \GL(n,2)\/\H\, which proves the 
claim). Since the n — )• oo limiting proportion of regular semisimple elements 
in GL{n,2) is 1/2, the theorem follows as (1/2) - (1/2) (5/6) = 1/12. □ 

Next we treat the case that /c — t- oo. Note that for g — )■ oo, we already 
have very good estimates on the proportion of derangements (see Theorem 
[QD. 



Theorem 9.4. Suppose that 1 < k < n/2 with q fixed. If k ^ oo, the 
proportion of elements of GL(n, q) which are derangements on k-spaces — >• 1. 
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More precisely, there are universal constants A, B such that for any e > 
and k, the proportion of derangements of GL{n, q) on k-spaces is at least 



Proof. Recall from Subsection 12. II that the conjugacy classes of GL{n, q) are 
parameterized by associating to each monic irreducible polynomial (p over Fg 
(disregarding the polynomial 4) = z) a. partition such that deg(i;^')|A0| = 
n. Furthermore the size of a conjugacy class with this data is 

\GL{n,q)\ 

where c^,A0 is an explicit function of A,^ and the degree of (j). 

As in Theorem 18 -H define D{a) to be the sum of the degrees (counted 
with multiplicity) of the irreducible factors which occur with multiplicity 
greater than one in the characteristic polynomial of a. Theorem 18. II implies 
that if a = ci + y^T' then the chance that D{a) < a is at least 1 — e. 

Thus it suffices to show that the proportion of elements a in GL{n,q) 
with D{a) = b < a and which fix a k-space goes to as /c — )• oo. Let 
Cg{z) denote the characteristic polynomial of g. Note that the proportion of 
elements of GL{n, q) with D{a) = b and which fix a fc-space is at most 

' 1 \geGL{b,q):Cg{ z)=il;\ 



t=0 ,j)eSi(n-b) ii<Pi^^ ' ^&S2{(t>) 

(Here Si{n—b) is the set of squarefree monic polynomials of degree n—b with 
nonzero constant term, with the property that some subset of its factors have 
degrees adding to k—t. The (pi are the irreducible factors of (p. The set S2{(p) 
is the set of monic polynomials ip of degree b with nonzero constant term, 
with the property that ip is relatively prime to (p and that all irreducible 
factors occur with multiplicity greater than one). This formula follows from 
the fact that any polynomial factors into a squarefree part and a relatively 
prime part where all factors have multiplicity greater than one. 
It is clear that 



E 



1 ^ \gGGL{b,q):Cgiz)=i;\ 



n.(gdes(<^0-l)_A.^^ \GL{b,q)\ 



:=0 </,GSi(n-fe) ^ '■'Pi ' Ve52(</>) 

h 



< 



E E 

t=0 </.e5i(n-b) 



n.,(gdeg(</..)-l) 



But 



E 



1 



is precisely the proportion of elements in GL{n — b,q) which are regular 
semisimple and which fix a (/c — t)-space. By Theorem 15. 1^ this is at most 
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the proportion of elements in Sn-b which fix a (A; — t)-set. Summing over 
(t, b) with < t < b < a, it fohows from Theorem 13.51 that the proportion of 
a G GL{n,q) with D{a) < a and which fix a /c-space is at most ^/^"i^.oi for 
a universal constant C. This yields the theorem since a = ci + \/^- □ 



Remark: Taking e = in Theorem 19.41 shows that the probability 

of fixing a k-space is at most A/k'^^^, for A a universal constant. 

9.2. SU. The results in this subsection parallel those in Subsection 19.11 
Note that in analyzing the action of the unitary groups on nondegenerate 
or totally singular k-spaces, one can suppose that 1 < A: < n/2. 

First we show that for fixed q, k, the large n proportion of derangements 
in subspace actions is uniformly bounded away from 0. 

Theorem 9.5. Let gSU (n, q) be a coset of SU (n, q) in U (n, q) . For k fixed, 
q fixed, and n — t- oo, the proportion of elements of gSU{n, q) which are de- 
rangements on nondegenerate (resp. totally singular) k-spaces is equal to the 
proportion of elements ofU{n,q) which are derangements on nondegenerate 
(resp. totally singular) k-spaces. 

Proof. The proof runs along the same lines as Theorem 19. 11 except that one 
uses Britnell's cycle index for SU{n,q) [B2] . Thus the sum over il,q-i is 
replaced by the sum over Qq2_i, and instead of just products over cp, there 
are two sets of products-one corresponding to self-conjugate polynomials and 
another corresponding to conjugate pairs of non-self-conjugate polynomials. 
Further details are omitted. □ 

The next lemma will be useful. 

Lemma 9.6. (1) ('[NPjJ The n — )■ oo proportion of eigenvalue free ele- 
ments in U{n, q) is 

(2) For q = 2 the proportion of part 1 is between .163 and .197. For 
q>3 the proportion of part 1 is at least 1/5. 

(3) The proportion of elements of U{n, q) which are derangements on 
nondegenerate 1-spaces is at least the proportion of part 1. 

(4) The proportion of elements of U{n, q) which are derangements on 
totally singular 1-spaces is at least the proportion of part 1. 

Proof. For part 2, when q = 2 the lower bound follows because ((1 — 1/2) • 
(1 + 1/4) • (1 - 1/8))^ > .163. The upper bound follows because ((1 - 1/2) • 
(1 + 1/4) • (1 - 1/8) • (1 + 1/I6)f < .197. For other values of q (except for 
a few which must be checked by hand using the method for q = 2) one uses 
an argument similar to that of part 2 of Lemma 19. 2[ 

Parts 3 and 4 follow since any eigenvalue free element of U{n, q) is a 
derangement on both nondegenerate and totally singular 1-spaces. □ 
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It is helpful to treat the cases q = 2,3 separately. 

Theorem 9.7. (1) For k > 2 fixed, the n — t- oo proportion of elements 
of U (n, 2) which are regular semisimple and derangements on non- 
degenerate k spaces is at least 1/20. 
(2) For k > 2 fixed, the n — t- oo proportion of elements of U{n, 3) which 
are regular semisimple and derangements on nondegenerate k spaces 
is at least 1/27. 

Proof. The stabilizer of a nondegenerate fc-space is U{k,q) x U{n — k,q). 
Hence by the logic of the q = 2 case of Theorem 19.31 the proportion of 
elements in U{n, q) which are regular semisimple and derangements on non- 
degenerate /c-spaces is at least the difference of the proportion of regular 
semisimple elements in U{n, q) and the proportion of regular semisimple el- 
ements in U{k, q) x U{n — k, q). Since k is fixed and n — )• oo, by Theorems 
[771 and mn the result follows for g = 2 since .414(1 - .877) > .05 and for 
g = 3 since .628(1 - .94) > 1/27. □ 

Theorem 9.8. Suppose that 1 < k < n/2 is fixed. Then for all but finitely 
many {n,q) pairs, the proportion of elements in any coset gSU{n,q) in 
U{n,q) which are derangements on nondegenerate k-spaces is at least 1/27. 

Proof. By the results of Section [U the proportion of elements in the coset 
gSU{n, q) which are regular semisimple goes to 1 as g — t- oo uniformly in 
n. Using this with Theorems 15.21 and 13.21 one concludes that for any e > 0, 
the proportion of elements in the coset gSU{n, q) which are derangements 
on nondegenerate /c-spaces is at least 1/3 — e for q sufficiently large. This is 
easily at least 1/27. 

For q fixed, Theorem [93] shows that it suffices to prove that the proportion 
of elements of U{n, q) which are derangements on nondegenerate A;-spaces 
is at least 1/27. By Theorem 17.71 for g > 4 the large n limiting proportion 
of regular semisimple elements of U{n,q) is at least .72. Together with 
Theorems 15.21 and 13.21 this implies that the n — )• oo proportion of elements 
of U{n, q) which are regular semisimple and derangements on nondegenerate 
fe-spaces is at least .72 — 2/3 > 1/27. For q = 2,3, the result follows from 
Theorem 19.71 and Lemma [9.61 □ 

Theorem 9.9. Suppose that 1 < k < n/2 is fixed. Then for all but finitely 
many {n, q) pairs, the proportion of elements in any coset gSU{n, q) of 
U{n, q) which are derangements on totally singular k-spaces is at least 1/26. 

Proof. By the results of Section [HJ it suffices to take q fixed. For q fixed, 
Theorem 19.51 shows that it suffices to prove that the proportion of elements 
of U{n, q) which are derangements on totally singular /c-spaces is at least 
1/26. Theorem 17.71 gives that the n — t- oo proportion of regular semisimple 
elements in U{n,q) is at least .628 for q>3. By Theorem 15.21 and Theorem 
14.31 the proportion of elements in U{n, q) which are regular semisimple and 
fix a totally singular fc-space is at most 1/2. This proves the theorem for 
q>2 since .628 - 1/2 = .128 > 1/26. 
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The final case to consider is g = 2. From Theorem [721 the large n limiting 
proportion of regular semisimple elements in U{n, 2) is at least .414. By 
Theorem 15.21 and Theorem 14.31 the chance that an element of U(n, 2) is 
regular semisimple and fixes a totally singular fc-space is at most 3/8 < .414 
for k >2. The result follows in this case since .414 — 3/8 > 1/26. Thus the 
only remaining case is k = l,q = 2, and this follows from Lemma 19.61 □ 

Next we treat the case that — )• cxd. Recall that for g — )• oo, we already 
have very good estimates on the proportion of derangements (see Theorem 

[631). 

Theorem 9.10. Suppose that 1 < k < n/2. 

(1) For q fixed, and k — )■ oo, the proportion of elements of U{n, q) which 
are derangements on nondegenerate k-spaces — t- 1. More precisely, 
there are universal constants A, B such that for any e > 0, and k, 
the proportion of elements of U{n, q) which are derangements is at 
least 

A 

e{k-B/^eyo^- 

(2) For q fixed, and k — t- oo, the proportion of elements ofU{n,q) which 
are derangements on totally singular k-spaces — )■ 1. More precisely, 
there are universal constants A, B such that for any e > 0, and k, 
the proportion of elements of U{n, q) which are derangements is at 
least 

. A 

' e{k-B/^e)-^- 

Proof. For part 1 we argue as follows. As in the proof of Theorem 18.11 
define D[a) to be the sum of the degrees (counted with multiplicity) of 
the irreducible factors which occur with multiplicity greater than one in the 
characteristic polynomial of a. Theorem 18.11 implies that if o = ci + 
then the chance that D{a) < a is at least 1 — e. Thus it suffices to show 
that the proportion of elements a vaU (n, q) with D{a) = b < a and which 
fix a nondegenerate k-space goes to as /c — t- oo. 

So we study the proportion of elements of U{n, q) with D{a) = b and 
which fix a nondegenerate fc-space. For any vector space V, an element g 
of U{V) has its characteristic polynomial expressible as f{z) ■ h{z), where / 
is multiplicity free, h is prime to /, and / is closed under the g-Frobenius. 
Then V is the direct sum of the kernels of f{g) and h{g). Applying this 
to any g-invariant subspace, it follows that the proportion of elements of 
U{n, q) with D{a) = b and which fix a nondegenerate /c-space is at most the 
sum as t goes from to 6 of the proportion of elements of U{n — b, q) which 
are regular semisimple and fix a nondegenerate k — t space. Arguing as in 
the general linear case (Theorem [93]), the result now follows from Theorems 
[Q and [331 

The proof of part two is nearly identical, except that one uses Theorems 
[52]and[43l □ 
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Remark: Taking e = in part 1 of Theorem 19.101 shows that the 

chance of fixing a non-degenerate k-space is at most A/k'^^^ for a universal 
constant A. Taking e = l/fe'^^ in part 2 of Theorem 19.101 shows that the 
chance of fixing a totally singular k-space is at most A/k'^^ for a universal 
constant A. 

9.3. Sp. This section considers the symplectic groups. For the action on 
nondegenerate 2k spaces, we suppose that I < k < n/2. Of course a totally 
singular space has dimension at most n. In even characteristic one must also 
consider the action on nondegenerate hyperplanes (viewing the Sp{2n, q) as 
n{2n+l,q)). 

To begin we discuss the case of k fixed. First we treat nondegenerate 
subspaces. 

Theorem 9.11. Let 1 < k < n/2 be fixed. The n — )• cxd proportion of 
elements in Sp{2n, q) which are regular semisimple and derangements on 
nondegenerate 2k spaces is at least .11 for q = 2, .05 for q = 2>, .11 for 
q = 4:, .13 for q = 5, .1 for q = 7, and .08 for q = 8. 

Proof. The stabilizer of a nondegenerate 2k space in Sp{2n, q) is Sp{2k, q) x 
Sp{2n — 2k, q). By Proposition 14.71 and part 3 of Theorem 15.31 it follows 
that the proportion of regular semisimple elements in Sp{2n, 2) or Sp{2n, 3) 
is at most 7/12 and 5/6 respectively. Hence the reasoning of Theorem 19.31 
for q = 2, together with Theorem 17.121 implies that for sufficiently large n 
the proportion of elements in Sp{2n, q) which are regular semisimple and 
derangements on nondegenerate 2k spaces is at least .283 * [1 — 7/12] > 
.11. Similarly one sees that for q = 3 the proportion of derangements on 
nondegenerate 2k spaces is at least .348*[1— 5/6] > .05. Recall that Theorem 
17. 141 gives that the proportion of regular semisimple elements in Sp{2n, q) is 
at most .74 for g = 4, .80 for g = 5, .86 for q = 7, and .88 for q = 8. Using 
the same reasoning as for g = 2, 3 one concludes that the n — )■ oo proportion 
of elements of Sp{2n, q) which are regular semisimple and derangements on 
nondegenerate 2k spaces is at least .453 * [1 — .74] > .11 for 5 = 4, at least 
.654 * [1 - .80] > .13 for g = 5, at least .745 * [1 - .86] > .1 for g = 7, and at 
least .686[1 - .88] > .08 for q = 8. □ 

Theorem 9.12. Suppose that 1 < k < n/2 is fixed. Then for all but 
finitely many (n, q) pairs, the proportion of elements in Sp{2n, q) which are 
derangements on nondegenerate 2k- spaces is at least 1/20. 

Proof. By Theorem 17. 131 when q ^ 00 the proportion of regular semisimple 
elements in Sp{2n, q) goes to 1 uniformly in n. Hence for q sufficiently large 
it follows from Theorems 15.31 and 13.21 that the proportion of derangements 
on nondegenerate 2k-spaces is at least 1/3 — e for any e > 0. This is easily 
more that 1/20. 

Suppose that q > 9 is fixed. By Theorem 17.121 the n — )• c« limiting 
proportion of regular semisimple elements in Sp{2n, q) is at least .797. By 
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Theorems l5.3l and l3.2l the proportion 
pie and fix a nondegenerate 2/c-space 
for g > 9 since .797 - 2/3 > .13. The 

Em 



of elements which are regular semisim- 
is at most 2/3. The theorem is proved 
remaining cases follow from Theorem 

□ 



To complete the discussion of actions on nondegenerate spaces, recall 
that in characteristic 2 there is the action of Sp{2n, q) on nondegenerate 
hyper planes. 

Theorem 9.13. Let q be even. 

(1) For \Sp{2n,q)\ sufficiently large, the proportion of derangements on 
nondegenerate positive type hyperplanes is at least .016. 

(2) For \Sp{2n,q)\ sufficiently large, the proportion of derangements on 
nondegenerate negative type hyperplanes is at least .016. 

Proof. We give details for the case of positive type hyperplanes as both the 
bounds and the proof for the case of negative type hyperplanes are the same. 

By Theorem l7.13| for q sufficiently large the proportion of regular semisim- 
ple elements in Sp{2n, q) goes to 1 uniformly in n. Then the theorem follows 
from part 1 of Theorem 15.41 

Next consider the case of q fixed. For q > 8, part 1 of Theorem 15.41 gives 
that at most 1 /2 of the elements of Sp{2n, q) are regular semisimple and fix 
a positive type nondegenerate hyperplane. From Theorem 1 7 . 1 2 1 one sees that 
for q > 8 even, the n — )• oo limit of regular semisimple elements in Sp(2n, q) 
is at least .686. Since .686 — 1/2 > .016, this proves the theorem for q > 8. 

For q = 2 one sees by Theorems 15.41 and 14.81 that the n — )• oo limiting 
proportion of elements of Sp{2n, 2) which are regular semisimple and fix a 
positive type nondegenerate hyperplane is at most j^ji < .215. However 
from Theorem 17.121 the n — )• oo limiting proportion of regular semisimple 
elements of Sp{2n, 2) is at least .283. The theorem follows since .283 — .215 > 
.016. 

For q = 4 one sees by Theorems 15.41 and 14.91 that the n — )■ oo limiting 
proportion of elements of Sp{2n, 4) which are regular semisimple and fix a 
positive type nondegenerate hyperplane is at most .437. By Theorem 17.121 
the n — )• oo limiting proportion of regular semisimple elements of Sp{2n, 4) 
is greater than .453. The theorem follows since .453 — .437 = .016. □ 



Next we consider the case of totally singular k spaces beginning with 
k = 1. Neumann and Praeger studied the proportion of eigenvalue free 
elements in Sp{2n,q), which is the same as the proportion of elements of 
Sp{2n, q) which are derangements on totally singular 1 spaces. 



Lemma 9.14. (|NPj ) 
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1^1) Suppose that q is even. Then the n — )• oo proportion of elements in 
Sp{2n, q) which fix no totally singular one- dimensional subspaces is 
/ 1 \ / 1 \ (9-2)/2 



i>l ^ ^ ' i>\ 



(2) Suppose that q is odd. Then the n — )■ cxd proportion of elements in 
Sp{2n, q) which fix no totally singular one- dimensional subspaces is 
/ 1 \ 2 / -I N (g-3)/2 

n 1-7^ n -7 

i>i ^ ^ ^ i>i ^ ^ ^ 

Proof. The only part not in [NP] is the lower bound of .4. This is proved 
along the same lines as Lemma 19.21 and we omit the details. □ 

Theorem l9.15l treats derangements on totally singular /c-spaces with k > 2. 

Theorem 9.15. (1) Let 1 < k < n be fixed. For n sufficiently large, 
the proportion of elements in Sp{2n, 2) which are regular semisimple 
and derangements on totally singular k spaces is at least .04. 
(2) Let 1 < k < n be fixed. Then for n sufficiently large, the proportion 
of elements in Sp{2n, 3) which are regular semisimple and derange- 
ments on totally singular k spaces is at least .03. 

Proof. Since the Levi subgroup of the stabilizer of a totally singular k-space 
is GL{k, q^) x Sp{2n—2k, q) it follows that when q = 2, the large n proportion 
of regular semisimple elements in the stabilizer of a totally singular k-space 
is at most e more than the products of the proportion of regular semisim- 
ple elements in GL{k, 4) and the n — )• oo proportion of regular semisimple 
elements in Sp{2n,2). Hence by reasoning similar to the q = 2 case of 
Theorem 19.31 it follows from Theorem 17.121 and part 2 of Theorem 17.61 that 
for n sufficiently large, the proportion of elements in Sp{2n, q) which are 
regular semisimple and derangements on totally singular k spaces is at least 
.283 * (1 — 6/7) > .04. The argument for part 2 is the same (using part 3 of 
Theorem EED and the bound follows because .348 * (1 - 83/91) > .03. □ 

Theorem 9.16. Suppose that 1 < k < n is fixed. Then for all but finitely 
many (n, q) pairs, the proportion of elements in Sp{2n, q) which are derange- 
ments on totally singular k-spaces is at least .03. 

Proof. By Theorem 17. 131 when q ^ oo the proportion of regular semisimple 
elements in Sp{2n, q) goes to 1 uniformly in n. Hence for q sufficiently 
large the result follows from part 2 of Theorem 15.31 and Theorem 14.41 since 

l-l/2>.03. 

For q > 4, k = 1, the result follows from Lemma 19.141 For > 4, A; > 2, 
recall from Theorem 17.121 that the fixed g, n — )■ oo proportion of regular 
semisimple elements in Sp{2n, q) is at least .453. The result follows from 
Theorems 15.31 and 14.41 since .453 — 3/8 > .03. For q = 2,3 the result follows 
from Theorem 19.151 {k > 2) and Lemma 19.141 (A: = 1). □ 
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Next we consider the case — )• oo. Recall that for g — )• oo, we already 
have very good estimates on the proportion of derangements (see Theorem 

Ell). 

Theorem 9.17. (1) Suppose that 1 < k < n/2. For q fixed and k — )• 
oo, the proportion of elements of Sp{2n, q) which are derangements 
on nondegenerate 2k- spaces converges to 1. More precisely, there 
are universal constants A, B such that for any e > and k, the 
proportion of derangements is at least 



e{k-B/^)-^^- 

(2) Suppose that 1 < k < n. For q fixed and k — )• oo, the proportion of 
elements of Sp{2n, q) which are derangements on totally singular k- 
spaces converges to 1. More precisely, there are universal constants 
A, B such that for any e > and k, the proportion of derangements 
is at least 

. A 

' e{k-B/^e)-^- 

Proof. Given an element g of Sp{2n,q), one can split it into a regular 
semisimple part and non-regular semisimple part (i.e. a part with a square- 
free characteristic polynomial f(z) and a relatively prime polynomial h{z) 
where all factors have multiplicity greater than 1). li g fixes a non-degenerate 
k-space, then for some t, the regular semisimple part fixes a non-degenerate 
k — t space, and the non-regular semisimple part fixes a non-degenerate t 
space. This is true since if W is any nondegenerate invariant space for g, 
then W is the sum oi W Ci ker{f{g)) and W H ker{h{g)). Then arguing 
as in the general linear and unitary cases (Theorems 19.41 and I9.10( ). using 
Theorems 15.31 and 13.51 one proves part 1. 

For part 2, one can replace non-degenerate by totally singular in the 
previous paragraph, and then use Theorems 15.31 and 14. 4[ □ 

Remark: Taking e = 1/k'^^^ in part 1 of Theorem 19.171 shows that the 
chance of fixing a non-degenerate k-space is at most A/h^^^ for a universal 
constant A. Taking e = in part 2 of Theorem 19.171 shows that the 

chance of fixing a totally singular k-space is at most A/h"^^ for a universal 
constant A. 

9.4. il. This section studies the proportion of derangements in subspace ac- 
tions of Vt. Note that when q is even, the case VL{2n+l,q) can be disregarded 
given that it is isomorphic with Sp{2n,q). 

First we treat the case of fixed k and even q, starting with k = 1. 

Lemma 9.18. Let q be even. Then the n — )• oo proportion of eigenvalue 
free elements of n^{2n,q) is 

/ 1 \ / 1 \ ('?-2)/2 

n n >-^- 

i>l ^ ^ ^ i>l ^ ^ ^ 
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Proof. It is easy to see that all eigenvalue free elements of O {2n,q) are in 
n^{2n,q). The n — )• oo proportion of eigenvalue free elements in 0^(2n, q) 
was calculated in [NP] (using generating functions) to be 



Lemma 19.181 immediatelv handles the case of the action of Q^{2n,q) on 
1-spaces where the quadratic form doesn't vanish, in even characteristic. 

Corollary 9.19. Let q be even. Then the n — )■ oo proportion of elements 
of ^}^(2n, q) which are derangements on the set of lines where the quadratic 
form does not vanish is at least .4. 

Next we treat more general non-degenerate spaces. Note that for q even, 
any odd dimensional subspace has a radical (with respect to the correspond- 
ing alternating form) and so the only time the stabilizer of an odd dimen- 
sional space is maximal is when it has dimension 1. The result in this case 
follows by Lemma 19.181 So we only need to deal with even dimensional 
nondegenerate spaces. 

Theorem 9.20. Suppose that 1 < k < n is fixed. Let q be even. For all but 
finitely many pairs (n, q), the proportion of elements in 0^(2n, q) which are 
regular semisimple and derangements on nondegenerate 2k-spaces of positive 
(resp. negative) type is at least .056. 

Proof. We prove the result for the case of positive type spaces since the 
negative case can be handled by replacing the word positive by the word 
negative in all places. 

If (; — )• oo, by Theorem 16 -H the proportion of regular semisimple elements 
in ri^(2n, q) goes to 1 for q sufficiently large uniformly in n. The result then 
follows from Theorems 15.61 and 14.61 since 1 — 1/2 > .056. 

Suppose that q is fixed. For q > 4, hy Corollary 17.181 the n — t- oo lim- 
iting proportion of regular semisimple elements in Q^{2n,q) is (1 H — 33^-) 
multiplied by the corresponding limit for the symplectic groups (given by 
Theorem 17. 12|) and hence is at least .573. The result follows from Theorems 
15.61 and 14.61 since .573 — 1/2 > .056. For q = 2, Corollary 17.181 and Theorem 
17.121 imply that the the n — )• 00 limiting proportion of regular semisimple 
elements in ft^{2n,2) is at least .47. The result follows from Theorems 15.61 



Next we analyze the case of totally singular fc-spaces when q is even. 

Theorem 9.21. Suppose that 1 < k < n is fixed. Let q be even. For all but 
finitely many pairs {n, q), the proportion of elements in il^(2n, q) which are 
regular semisimple and derangements on totally singular k-spaces is at least 




The inequality is from Lemma 19.141 



□ 



and EU since .47 - .414 > .056. 



□ 
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Proof. From Theorem 16. H the proportion of regular semisimple elements in 
goes to 1 for q sufficiently large uniformly in n. Thus by part 4 of 
Theorem 15.61 and Theorem 14.51 the result follows for q sufficiently large since 

l-l/2>.073. 

Suppose that q is fixed. For > 4, by Corollary 17.181 the n — )• oo lim- 
iting proportion of regular semisimple elements in 0^(2n, g) is (1 H — s^j-) 
multiplied by the corresponding limit for the symplectic groups (given by 
Theorem 17. 12p and hence is at least .573. The result follows from Theorems 
15.61 and 14.51 since .573 — 1/2 > .073. For q = 2, Corollary 17.181 and Theorem 
17.121 imply that the the n — t- c« limiting proportion of regular semisimple 
elements in i^^{2n, 2) is at least .47. For k > 2 the result follows from The- 
orems [521 and [33] since .47 — 3/8 > .073. The case q = 2,k = 1 follows from 
Lemma [913 □ 

Next we consider the case of q odd. We begin with the case of 1-spaces; 
some related results are in |NP] . 

Theorem 9.22. Let q be odd and fixed. 

(1) The n — )• oo limiting proportion of regular semisimple eigenvalue free 
elements in Vt^[2n,q) is equal to the corresponding limiting propor- 
tion for SO^{2n,q). This proportion is equal to (1 + )~^''^^''^^ 
multiplied by the limiting proportion of regular semisimple elements 
in the symplectic groups (given in Theorem |7. ji^[ ). For q > 3 this 
product is at least .348. 

(2) The n — 7- oo limiting proportion of regular semisimple elements in 
r2(2n+l,g) which are derangements on positive (resp. negative) type 
1-spaces is equal to the limiting proportion for SO{2n + l,g). For 
q > 3 this proportion is at least ^(1 + ^^)~^'^~^^^^ multiplied by the 
limiting proportion of regular semisimple elements in the symplectic 
groups (given in Theorem \ 7.12^ ; hence this proportion is at least 



Proof. For part 1 of the theorem, the argument of Theorem 17.251 implies 
that the n — )• oo limiting proportion of eigenvalue free regular semisimple el- 
ements in J7^(2n, q) is equal to the corresponding proportion in SO^{2n, q). 
Indeed, to bound the difference between the proportions, instead of sum- 
ming over all bad Weyl group conjugacy classes, one sums only over bad 
Weyl group conjugacy classes without fixed points. Letting t^ denote the 
number of regular semisimple eigenvalue free elements of SO^{2n, q), using 
the methods of [FNP] one obtains that 



.174. 




q'^ + l 




M*(q;d) 
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which one recognizes as (1 + ■^^)~^'^~'^^^'^ multiphed by the generating func- 
tion for regular semisimple elements in the symplectic groups. From this 
and an analysis of the difference of the the generating functions for and 
t~ (showing its contribution to be negligible), part 1 of the theorem follows. 

For part 2 of the theorem (as in part 1), the equality of the large n limiting 
proportions follows by the technique of Theorem 17.251 Next, observe that a 
regular semisimple element a in S0{2n+ l,q) is a derangement on positive 
(resp. negative) 1-spaces if it is eigenvalue free except for the z — 1 factor, 
which has negative (resp. positive) type and occurs with multiplicity one. 
The result now follows from a generating function argument similar to that 
in the previous paragraph. □ 

Next we consider the proportion of derangements in the action of il^(n, q) 
on nondegenerate and totally singular subspaces. Theorem 19.231 shows that 
if one restricts to regular semisimple elements, then as n — )• oo it is sufficient 
to work in SO^{n,q). 

Theorem 9.23. Let q be odd and fixed. 

(1) The n — )• cxD limiting proportion of regular semisimple derangements 
in f2^(n, g) on nondegenerate k-spaces of positive (resp. negative) 
type is equal to the corresponding limit for SO^{n,q). 

(2) The n — )• oo limiting proportion of regular semisimple derangements 
in 0,^{n,q) on totally singular k-spaces is equal to the corresponding 
limit for SO^{n, q). 

Proof. Both parts follow by the technique of Theorem 17.251 since instead of 
summing over all bad conjugacy classes in the Weyl group, one only sums 
over those bad conjugacy classes which could correspond (this correspon- 
dence was discussed in Section [5]) to regular semisimple derangements. □ 

Theorem 9.24. Let q odd and 1 < k < n be fixed. For all but finitely many 
{n,q) pairs, the proportion of elements in Q{2n + l,*;) which are derange- 
ments on nondegenerate k spaces of positive (resp. negative) type is at least 
.07. 

Proof. By Theorem l6.lt the proportion of elements in il(2n+ 1, q) which are 
semisimple goes to 1 as g — t- oo uniformly in n. Hence for q sufficiently large, 
it follows from Theorems 15.51 and 13.21 that the proportion of derangements 
on nondegenerate k-spaces is at least 1/3 which is bigger than .07. 

For q > 5, Theorems 17.201 and 17.251 give that the n — t- oo proportion of 
strongly regular semisimple elements in J7(2n + l,q) is at least .654. From 
Theorem 15.51 and part 3 of Theorem 14.61 the proportion of strongly regular 
semisimple elements in ^l{2n + 1, g) which fix a nondegenerate k-space is at 
most 1/2. The result follows for q > 5 since .654 — 1/2 > .07. If g = 3, 
Theorems 17.201 and 17.251 give that the n — )• oo proportion of strongly regular 
semisimple elements in Q(2n + 1, q) is at least .348. The result now follows 
from Theorems [53] and KT2\ since .348 - .276 > .07. □ 
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Theorem 9.25. Let q be odd and 1 < k < n be fixed. For all but finitely 
many {n,q) pairs, the proportion of elements in ^}^{2n,q) which are de- 
rangements on nondegenerate k spaces of positive (resp. negative) type is at 
least .07. 

Proof. By Theorem 16. H the proportion of elements in Q.^{2n,q) which are 
semisimple goes to 1 as g — )• cxd uniformly in n. Hence for q sufficiently 
large, it follows from Theorems 15. 6^ 15.71 and 13.21 that the proportion of de- 
rangements on nondegenerate k-spaces is at least 1/3 which is bigger than 
.07. 

Thus we can suppose that q is fixed. First assume that k is even. By 
Theorems 17.221 and 17.251 for (7 > 5, the n — )• 00 proportion of strongly 
regular semisimple elements in f]^(2n, g) is at least .654. Thus Theorems 
15.61 15.71 and 14.61 imply the result since .654 — 1/2 > .07. If g = 3, Theorems 
17. 221 and 17. 251 give that the n — >• 00 proportion of strongly regular semisimple 
elements in Q.^{2n, q) is at least .348. The result follows from Theorems 15. 6| 
O and Sia since .348 - .276 > .07. 

Next suppose that k is odd. Then any semisimple element fixing a non de- 
generate A:-dimensional space has a two dimensional eigenspace correspond- 
ing to an eigenvalue ±1. Now apply Theorem 19.221 □ 

Theorem 9.26. Let q be odd and 1 < k < n be fixed. For all but finitely 
many {n,q) pairs, the proportion of elements in ^}{2n + l,q) which are de- 
rangements on totally singular k spaces is at least .07. 

Proof. By Theorem 16. 1^ the proportion of elements in ^}{2n + l,q) which 
are regular semisimple goes to 1 as g — )• 00 uniformly in n. Hence for q 
sufficiently large, it follows from Theorem 15.51 and 14.41 that the proportion 
of derangements on totally singular k-spaces is at least 1/2 which is bigger 
than .07. 

Thus we can suppose that q is fixed. For q > 5, Theorems 17.191 and 
17.251 give that the n — )• 00 proportion of regular semisimple elements in 
fl{2n + l,q) is at least .790. From Theorems 15.51 and 14.41 the proportion 
of elements in 0(2n + l,q) which are regular semisimple and fix a totally 
singular k-space is at most 1/2. The result follows for q > 5 since .790—1/2 > 
.07. If g = 3, Theorems 17.191 and 17.251 give that the n — )• 00 proportion of 
regular semisimple elements in ^}{2n + 1, g) is at least .478. The result now 
follows for k > 2 from Theorems 15.51 and 14.41 since .478 — .375 > .07. 

The remaining case is when q = 3 and k = 1. In fact, we can give 
an alternate proof that works in all cases (albeit with a worse bound than 
above). Note that if a semisimple element fixes a totally singular /c-space, 
then it fixes a nondegenerate 2fc-space (of + type). Now apply Theorem l9.241 
noting that its proof actually lower bounded the proportion of semisimple 
derangements. □ 
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Theorem 9.27. Let q be odd and 1 < k < n be fixed. For all but finitely 
many {n,q) pairs, the proportion of elements in ^}^{2n,q) which are de- 
rangements on totally singular k spaces is at least .15. 

Proof. By Theorem 16. H the proportion of elements in Q^{2n,q) which are 
regular semisimple goes to 1 as g — t- oo uniformly in n. Hence for q suf- 
ficiently large and A; < n, it follows from Theorems 15. 6|, 15.71 and 14.51 that 
the proportion of derangements on totally singular k-spaces is at least 1/2 
which is bigger than .15. For q sufficiently large and 1 < k = n, it follows 
from Theorems 15.61 15.71 and part 2 of Theorem 14.51 that the proportion of 
derangements on totally singular n-spaces is at least 1 — 2(3/8) > .15. For 
k = 1, the result follows by Theorem 19.221 

Thus we can suppose that q is fixed. Theorems 17. 21 1 and 17. 251 give that for 
q > 3, the n — )• oo proportion of regular semisimple elements in Q,^{2n,q) 
is at least .657. From Theorems 15.61 15.71 and 14.51 the proportion of regular 
semisimple elements in Q^{2n,q) which fix a totally singular k-space is at 
most 1/2. The result follows since .657 — 1/2 > .15. □ 

To conclude, we treat the case k — )• oo. Recall that for q — >■ oo, we already 
have very good estimates on the proportion of derangements (see Theorem 
El- 

Theorem 9.28. Suppose that 1 < k < n/2. 

(1) For q fixed and k — t- oo, the proportion of elements in $7^(n, q) which 
are derangements on nondegenerate k-spaces converges to 1. More 
precisely, there are universal constants A, B such that for any e > 
and k, the proportion of derangements is at least 



e(fc-S/^)-Oi- 

(2) For q fixed and /c — )• oo, the proportion of elements in Q.'^{n, q) which 
are derangements on totally singular k-spaces converges to 1. More 
precisely, there are universal constants A, B such that for any e > 
and k, the proportion of derangements is at least 



e{k-B/^ey>- 

Proof. For q even, the proof is nearly identical to the symplectic case (The- 
orem [9T7]), and we omit further details. For q odd, we work in SO instead 
of in so that generating functions can be used. Clearly the result for SO 
implies the results for Vl (with different universal constants). □ 

Remark: Taking e = 1/k'^^'-' in part 1 of Theorem 19.281 shows that the 
chance of fixing a non-degenerate k-space is at most A/k'^^^ for a universal 
constant A. Taking e = l/k'"^^ in part 2 of Theorem 19.281 shows that the 
chance of fixing a totally singular k-space is at most A/k'"^^ for a universal 
constant A. 
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